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ABSTRACT 

NortKwest Regional Educational Laboratory's (NWREL) 
Research Evaluation Program provides assistance to educators based on 
its research, development, testing, and training activities 
concerning new methodologies for educational evaluation. This report 
describes the assistance provided to educational practitioners in 
1984 through support materials, consultation, and direct training. 
New method assistance focused on microcomputer use in evaluation; 
several publications were provided. A number of aids were provided to 
practitioners interested in cost analysis and in policy analysis. 
Training programs focused on microcomputer use in evaluation and cost 
analysis. Over 150 pages of this document are divided among four 
appendices: (1) Cost Communiques, a NWREL newsletter describing 
research in cost analysis; (2) materials for a workshop using 
microcomputers in evaluation and assessment; (3) visual aids to 
accompany a presentation on microcomputers; and (4) materials and 
visual aids for a cost analysis workshop. (GDC) 
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r PREFACE 

* ■ 

♦ • i 

The Research on Evaluation Program is a Northwest Regional i 
Educational Laboratory project of research, development, testing, / 
and training designed to create new evaluation methodologies foi\f 
U3e in education* This document is one of a series of papers and 
reports produced by program staff , visiting %ftiolars, adjunct 

* scholars , and project collaborators— all members of a cooperative 
network of colleagues working on the development of new 

* methodologies* 

« 

What types of assistance have been provided by the Research on 
Evaluation Program during 1984.? This report reviews the * 
activities related to new methods assistance, cost analysis 
assistance, policy analysis assistance, and training and training ' 
materials. 

Nick L. Smith, Editor 
Paper and Report Series 
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METHOD ASSISTANCE- REPORT 

• * 

Over Che history of the Research on Evaluation Program 
(ROEP) , an extensive variety of methods for conducting evaluation 
studies has been assembled. These methods have been drawn from 
an array of areas outside educational research and evaluation. 
During 1984 part of the Program's scope of work was to provide 
assistance to people in the field in using the methods previously 
developed.- * ° 

In order to efficiently use the resources available to the 
Program, two types of approachea/were implemented to provide 
assistance. One was the development of an Annotated Bibliography 
of Practitioner Aids developed by the Research on Evaluation 
Program (January 1984). The bibliography contains brief 
descriptions of over 40 reports, checklists, bibliographies, and. 
other materials specifically intended for use as aids in 
planning, conducting, and reporting evaluations. This 
bibliography was used to inform potential users of the , 
availability of aids for the evaluation practitioner. Summaries 
of requests for the aids under new methods assistance, cost 
analysis assistance, and policy analysis assistance are provided 
in those sections of this report. 

The second approach to providing assistance was a series of 
training sessions. These were held to provide direct assistance 
to practitioners, as described in the training section of this 
report. The materials used in these sessions may be found in the 
Appendices. Based on this work, a series of guides will jbft 
finalized in 1985 (interim drafts of the first ten guides appear 
in Report No. lbl) ? the guides will be used to provide cont nued, 
assistance to practitioners. 



New Method Assistance 

\ • 

The category of new toe thodV covers a variety of topics which 
have been the focus of previous Program efforts. Chief among 
them is. the ,use of microcomputers in evaluation. 

Microcomputers . 

As shown in Table 1, 98.. requests have been made for 
practitioner aids related to microcomputers. Two of "these aids 
(accounting for 67 requests) were produced during > 1984. 

The following are brief descriptions of the 1984 practitioner 
assistance studies and aids related to microcomputers. . 

No. 94, Computers Plus: The Organization, Operation, and 
Evaluation of an Intensive Summer Program Designed to Develop 
.Computer Literacy Among Educators 

Authors: P. J. Gray and J. Tafel; January 1984, 48 pages 

How should workshops to increase the computer literacy of 
teachers and administrators be designed, organized, and 
operated to meet the increasing needs of diverse students? 
This report dejscr-ibes one series of four summer courses - 
developed to provide introductory students with basic 
concepts,- hands-on computer experience, practice in software 
evaluation, and assistance in planning for microcomputer 
use. The report has been produced to provide one 'model for 
meeting the currenjt high demand for such workshops. 
* 

No. 95, Computer Use Planning: A Case .Study of a School 
District' s.Long Range Planning Efforts 

Authors: P. J. Gray and L. J. Rawers; May 1984, 53 pages 

How do school districts form .policies about the instructional 
and administrative uses of computers? How do school 
policy-forming cpmmit.tees "function, and how can their 
operations be time more effective? These and related 
questions are addressed in this case study of one district's 
initial attempts to establish policy about the use of 
computers in the schools. This report focuses on the 
operations, of the policy formation committee, its 
composition, activities, and**products. An analysis of this 
case example is used as a basis for recommendations about how 
other districts can betcer develop computer policies. 
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No. 98, Microcomputer a and Evaluation Research: Potential - 
Benefits ''and Problems ' 
Author r P. J. Gray; Nay 1984, 15 pages . 

What pre the applications that might & made o. 
microcomputers in evaluation, and what are the V..nds of 
problems (personnel, organizational and technical) that must 
be overcome if microcomputers are to be used effectively? 
These questions are addressed in this brief Introduction to 
the use of microcomputers in evaluation work. 



Table 1 

Hew Methods Assistance Requests 
Microcomputer Aids 



No. of 

Report No. Title * * •> Requests 

76 * Open-ended Checklist for Evaluation of 

Microcomputer Software 6 

89 Microcomputer Workshop Materials 14 

91 Guide to Use of DB .MASTER 11 

94 How to Develop an Intensive Computer 

Literacy Program for Educators 9 

98 Microcomputers an^ Evaluation Research: 

Potential Benef i ;s aiCd Problems 58 

Total 98 

* 

Aids on Other Topics 

c No. of 

Report No. x Title Requests 

■ 61 Bibliography of Evaluation Utilization 1 

74 Management Consulting Case Study 1 

75 Public Data Bases * • 3 
78 Document Analysis Exercises 1 
96 Evaluation Units in State Departments of 

Education:. A Five-Year Update 9 

99 Foundation Support of Evaluation 8 
Evaluation Contracting Checklist* 2 
New Techniques for Evaluation** 3 

Total * 28 



'Informal documents 
**Prograra-produced bdok 



HpV- 101, Guides to Evaluation Methods 1 

Editors: P. J. Gray and J. F. Turnidge* September 19W, 146 pages 

This report contains interim drafts of ten guides designed to 
acquaint evaluatora with new tools for usfng cost analysis,, 
microcomputers, investigative methods, and other approaches * 
in evaluation. These guides are based upon previous Program 
research and publications, and will be distributed as 
individual documents upon final revision. 

« m 

" Four of the guides produced by the Program were converted 

c 

into articles and published as part of an ongoing column, 
Microcomputers and Evaluation, in Evaluation News . The topics 
covered by these articles were word processing, data base 
management, statistical analysis, and the evaluation of 
professional software. In this form they received wide 
dissemination. 



Other Topics 

Table 1 also shows, that 28 requests were made^ for 
practitioner aids on topics other than microcomputers (e.g., 
management ^consulting, document analysis). Several of these 
topics appeared in Program products developed during 1984, 
including new support materials for using investigative methods} 
product evaluation techniques, and hearings approaches in 
evaluation (see Report-No. 101). The following are brief 
descriptions of other 1984 new method resources. 

No. 96, Evaluation Units in State Departments of Education: A 
F; j-Year Update 

Author: N. L. Smith.; May 1984, 12 pages 

How have the evaluation units, in state departments of 
education changed in the last five years? Have there^been 
changes in their staffing patterns and in the nature and 
amount of their work? Answers to these and^ related questions 
are provided in this report which summarizes the results of 
two surveys (one in 1978, the other in 1983) which 
investigated the nature a£ state department evaluation 
operations. The report ends with information on the 
projected needs of these evaluation units over the next tew 
years. 
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Nof 99, Foundation Support of Evaluation 
Author: N. L. Smith; August 1984 , 31 •pages 

« 

A computer ize/"aearch pf the Foundation Grants Index 
conducted to identify the nature and extent of foundation 
awards for evaluation wprK. the awards granted between 1972 
and 1983 are described here in terms jof size of grants, 
nature of recipients and supporting foundations, yearly and 
geographic distribution. patterns, and topical areas of 
primary support. Because so, few awards were found, three 
fdllow-up questions are also addressed. What is the actual 
level of foundation activity in evaluation? v How public is 
foundation work in evaluation? and To what extent is 
foundation (evaluation activity accurately represented in the . 
Foundation Grants Index?. Foundation resource materials are * 
also summarised* - 

No. 101, Guides to Evaluation Methods 

Editors: p. J. Gray and J. F. Turnidge; September 1984, 146 pages 

This repot t contains interim drafts of ten guides designed to* 
acquaint evaluators with new tools for using cost analysis, 
microcomputers, investigative methods, and other approaches^ 
in evaluation. These guides are based upon previous Program 
research and publications, and will be distributed as 
individual documents upon final revision. 
* ■ 

No. 2 02, Finding the Questions for- Evaluation Research 
Author: J. T. Dillon; October 1984, 31 pages 

Evaluation research can be* conceived of as a 
question-answering process, and its resulting knowledge 
* conceived of as a question-answer proposition. The 
theoretical "study of questions suggests four practical 
strategies' £or undertaking an evaluation study. (1) Before 
identifying the question to investigate, classify the 
l^^uestions that can be asked. (2) Before posing the question, 
analyze it. (3) Before addressing the question, construct a 
dummy answer. (4) Before stating the answer, state the 
questions. In general, it makes pragmatic sense to expend at 
least as much effort on finding the question as on finding 
the answer. 



Cost Analysis Assistance 

One of the major topics of interest among both regional 
clients and NWREL staff is cost analysis. The Research on 
Evaluation Program has been conducting work on this method for 
several years. Over the past years there have been several 
repeats on cost analysis in the. Program series, such as "Manual 

5 ii 



.for Cost Analysis in Educational Evaluation"* by Levin and Seidroan 
(roep Paper and Report Seri'es No.. 65, November 1981) , and_ 
•Multiple Alternative's Modeling in Determining Piscal Roll-backs 
during Educational Funding Crisen" -by Wholeben and Sullivan (ROEP 
Paper and He^rt. Series No. 7;o, March 1982), as well as a variety 

* 

of suppoH materials and workshops. 

Building on this background of* experience and expertise, the 
Program developed several practitioner aids in this area. In 
addition, as will be reported later, a -number of training 
sessions were conducted on cost analysis. 
/^Table 2 shows that 410 requests were made for past and 

A 

current^practitioner aids related to cost analysis. The 
following are brief descriptions of 1984 cost analysis, products. 



« 

No. 100, Cost Analysis in Educational Evaluation 

Authors: N. Li Smith and J. K. Smith? September 1984, 51 pages 

' What kinds of cost analysis studies are being done in 
. educational evaluation? The educational literature shows 
very few applications of cost methods, especially the 
seemingly most appropriate method: cost effectiveness 
analysis. The health literature shows a greater use of cost 
methods, but for treatment or intervention research rather 
than for program management purposes as iu education. An 
examination of a contracting firm»a cost studies' revealed the 
use of only the simplest cost methods and those for 
manageraent*purposes. A national study of SEA evaluation 
units showed an increasing mandate for the use of cost 
methods and a movement toward the use of somewhat more 
». complicated' procedures. An interpretation of these findings 
uaing knowledge transfer theory shows that practitioners have 
little problem with the credibility and relevance of cost 
(•methods, but have major difficulties in understanding and 
implementing them. 

No. 101, Guides to Evaluation Methods 

Editors: P. J. Gray and J. F. Tur nidge; September 1984, 146 pages 

Thii report contains interim drafts of ten guides designed to 
o acquaint evaluatora with new tools for using cost analysis, 
microcomputers, investigative methods, and other approaches 
in evaluation. These guides are based upon previous Program 
research and publications, and will be distributed fcs 
individual documents upon final revision. 
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A newsletter, Cost Communique, is another Program resource on 
cost analysis* This newsletter informs Northwest Regional 
Educational Laboratory staff about cost analysis procedures, 
methods, resources, and studies* Three issues were published in 
1984* with a circulation of 75 per issue. As a result, a total 
of 225 copies of the Cost Communiques shown in Appendix A were 
distributed* 



Table 2 
Cost Assistance &ids 



No. of 

Report No. Title Requests 

82 Cost-Analysis Case Studies 2 

85 Coat-Analysis Technical Research Report 5 , _ 

86 Alternative Teacher Preparation Programs: 

A Cost-Effectiveness Comparison ^ 

87 Proceedings bf a Seminar on Cost Ana* - is 3 

88 Cost A slysie Bibliography x , 55 
Cost Effectiveness Checklist* 1 
Introductory Discussion of Cost Analysis* 31 
Cost-Effectiveness t A Primer** 83 
CO$T Conuiunique*** % * 225 

Total '410 



♦Informal documents 
**Prograra-produced book 
***Per iodic program newsletter 
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Policy Analysis Assistance 



Policy analysis has been identified as a critical area for 
decision makers to become familiar with. Over the last several 
years, the Program has developed a number of practitioner aids in 
policy analysis. As shown in Table 3, 80 requests were made for 
these resources, two of which were developed in 1984. These two 
aids describe methods for conducting policy analysis studies on 
the topic of microcomputer use, a problem area of policy 
analysis. Following are brief descriptions of the two aids. 

No. 95, Computer Use Planning:" A Case Study of a School 

District's Long-Range Planning Efforts 

Author* P. J. Gray and L. J. Rawers; May 1984, 53 pages 

How do school districts form policies about the instructional 
and administrative uses of computers? How do school 
policy- forming committees function, and how can their 
operations be made more effective? These and related 
questions are addressed in this case study of one di"strict's 
initial attempts to establish policy about the use of 
computers In the schools. This report focuses on the 
operations of the policy formation committee, itsi 
composition, activities, and products. An analysis of this 
case example is used as a basis for recommendations about how 
other districts can better develop computer policies. 

No. 97, Policy Analysis: A Tool for Setting District Computer Use 
Policy 

Author: P. J. Gray; May 1984, 23 pages 

How can policy analysis procedures be used to help scHool 
districts set policy on computer use? This report addresses 
that question by discussing the steps in the policy formation 
and implementation processes, outlining how policy analysis 
methods can contribute to the creation of effective policy. 

Published in Educational Leadership , October 1984. 

» 

v 

Training * 

Two topics were the focus of training for practitioners by 
Program staff: one is microcomputer use in evaluation, and the 
other, cost analysis. 
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Table 3 

Policy analysis Assistance Aids 



No. of 

Report No, Title Requests 

69 The Use of Assignment and Transpqrtation 

Models in Evaluation 1 

70 Multiple Alternatives Modeling in 

Determining Fiscal Roll-Backs During 

Educational Funding Crises 2 
73 MICROPIK: A Multiple-Alternatives, 

Criterion-Referenced Decisioning Model 

for Evaluating CAI Software and 

Microcomputer Hardware Against Selected 

Curriculum Instructional Objectives 2 
83 A Primer on Decision Analysis Procedures 2 

92 - 0 Dimensions of Moral and Ethical Problems 

in Evaluation 21 
95 Computer Use Planning: A Case Study of . 

a School District's Long-Range 

Planning Efforts 40 
97 Policy Analysis: A Tool for Setting 

District Computer Use Policy 12 

Total 80 



Microcomputers 

Four training sessions were held on microcomputers in 
evaluation during 1984. One occurred at an invitationaJ. 
conference sponsored by*.the Washington Educational Research 
Association. Some 50 participants were involved in that 
session. Training topics included the use of word processing, 
data base, statistical analysis, and other programs in 
evaluation. The materials for that workshop may be found in 
Appendix B. 

A second training session occurred at the Education 
Commission of the States 1 Large Scale Assessment Cgnference. 
This session reviewed the uses of microcomputers in evaluation 
and described the important concepts related to the evaluation of 
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microcomputers for instructional purposes. The presentation 
materials used for this session are in Appendix C. Twelve people 
attended the session. , 

The third training session was an introduction to 

i 

microcomputers in evaluation research conducted at Evaluation 
•84, the joint annual meeting of the Evaluation Network and the 
Evaluation Research Society. A fourth training session involving 
a software information exchange also took "place during Evaluation 
•84. A total of 50 people attended these two sessions. 

« 

Coat Analysis 

Six events provided training ex,«eriej*ces for practitioners on 
cost analysis topics. One was a workshop attended by 15 Colorado 
educators held in cooperation with the Northern Colorado Board of 
Cooperative Educational Services. 

There were also three workshops sponsored by the Chapter 1 
Technical Assistance Program at the' Laboratory. These were 
conducted by an ROEP staff member using Program developed 
materials. A total of 52 people attended these sessions (25 in 
Arizona, 12 in California, and 15 in Washington). The workshop 
materials used in these sessions are in Appendix D. 

The last two cost-related events invoJved the presentation of 
papers on practical topics at Evaluation '84, the joint annual 
meeting of the Evaluation Network and the Evaluation Research 
Society. These sessions, attended by 70 people, addressed the 
topics of "Economists' and Evaluators' Perspectives on 
Cost-Outcome Analysis: A Call for Convergence," and "The Use of 
Cost Analysis in Health Evaluations: A Review of the Literature." 



16 



10 



Summary 

In summary, several hundred contacts were made with 
practitioners during 1984. These contacts were through providing 
support materials, consultation, and direct training. These 
assistance activities were conducted as a means of service 
delivery as well as a way to field-test and refine the evaluation 
approaches and support materials being developed by the Program 
through its other 1984 research and development activities. 
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Footnote 



It should be noted that Report 101, Guide to Evaluation 
Methods, appears in several of the lists. The reason for 
this is that guides in the report cover microcomputer, cost 
analysis, and other topics. 

r . 

4 

>» 
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CO$T COMMUNIQUE No. 4, February 1984 

« 

**************************** ********* 

NWREL COST STUDY WINS NATIONAL AWARD 



A study titled "Alternative Teacher Preparation Programs:, A 
Cost-Effect>veness Comparison" by Nick Smith (NWREL) and Jon Denton 
(Texas A&M University) has received the Association of Teacher Educators' 
1984 Distinguished Research Award* The study, described in the last 
issue of the COST COMMUNIQUE, concerns two questions, (1) which of two 
existing. secondary education teacher preparation programs is more 
effective in preparing students to teach, and (2) when program costs are 
considered, do the increased student performances warrant the 
differential increase in costs? 

The full report is No. 86 in the Research on Evaluation Program Paper and 
Report Series. ^ 

cost Analysis for educational administrators 



A recent article by Jana Kay Smith and Nick Smith has appeared in the 
School Information and Research Service Bulletin (SIRS) • Using a 
conversational tone, the authors introduce administrators to four... common 
cost-analysis methods, and provide examples to illustrate that these 
techniques, as applied to the evaluation of instructional programs, are 
much more straightforward and understandable than they first appear. 

The four formal cost-analysis methods seen as having the greatest 
usefulness in education are cost-feasibility, cost-utility , cost-benefit, 
and cost-effectiveness analyses. The first method, cost-feasibility 
analysis, is useful for determining whether a program is affordable 
within budgetary constraints. The last three methods enable one to 
combine outcomes with costs to determine the most cost-efficient 
program. Smith and Smith first discuss each cost-analysis method and 
then apply it to the . same hypothetical educational problem to help 
highlight the differences in the methods. 

In summarizing their article, the authors suggest that the 
cost-feasibility methods should be used when determining whether a 
program is economically feasible under budgetary constraints. No outcome 
data are taken into account using this method, and consequently there is 
no evidence to suggest which program is more effective. ^Cost-utility 
analysis goes one step beyond cost-feasibility and adds* estimates of 
program outcomes. Because the outcome data are estimated gather than 
actually measured, however, the reliability of the analysis can be 
questioned, although it may be helpful in planning situations. 
Cost-benefit analysis places a dollar figure 'on program outcome which is 
then compared to the cost of the program. It is often difficult to value 
educational outcomes in dollar terms and, as a result, the usefulness of 
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this method is generally limited to vocationally-oriented instructional 
programs. Finally, cost-effectiveness analysis involves collecting data 
on program effects using traditional evaluation measures. These measures 
are then compared to the cost of the alternatives. Cost-effectiveness 
analyses are appropriate for evaluating programs with identical or 
similar outcojne measures. 

The authors recommend cost-effectiveness analysis, of the four 
techniques, as the best method for use in the full evaluation of 
alternative instructional programs. Only for programs like 
vocationally-oriented interventions designed to improve student 
marketability or job performance would cost-benefit analysis be the ^ 
preferred method. 

in conclusion, Smith and Smith point out that the differences between the 
four major types of cost-analysis methods are clear and easy to 
understand. Although conducting a cost analysis study can require 
considerable time, effort, and expertise, it is stressed that 
administrators already have a sufficient understanding of the basic 
approaches to consider using formal cost studies in their own work. 



ASPECTS OF MEASURING COST EFFECTIVENESS IN 
EVALUATION. TECHNICAL ASSISTANCE EXPLORED 

Gary Estes' 1983 paper presented at the annun meeting of the American 
Educational Research Association focused on :he issues which need to be 
considered prior to promoting -cost-effectiveness" strategies for 
evaluating Chapter 1 Evaluation Technical Assistance Centers (TACs) . 
Estes makes the emphatic point in the paper that a need exists to be 
explicit about desired outcomes, costs for providing services, and the 
relationship between costs and outcomes. 

Decisions about "cost-effectiveness" should be based on a close 
examination of (1) where resources are allocated or used, (2) the 
specified outcomes, and (3) the hypothesized relationship between the 
inputs and outcomes. For example, in regard to Chapter 1 evaluation 
technical assistance, the workshops, consultations, phone calls, and so 
on may be considered input since all of the TAC's resources are used to 
provide these services. The cost ingredients list regarding inputs 
includes: personnel, travel, phones, materials, facilities, indirect 
cost and fees, and other costs such as client travel and outside 
consultants. The anticipated effects of these expenditures, as defined 
by the goals of Chapter 1 evaluation technical assistance, might be 
defined as (1) the number of Chapter 1 reports submitted, (2) the quality 
of the data in these reports, (3) the utility of evaluation results in 
making local decisions, and (4) client satisfaction regarding the 
services provided. However, as Estes reports, specific effects/outcomes 
and criteria for judging the magnitude of these effects are not clear. 
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In the absence of clear criteria for these effects, previous studies 
evaluating the cost-effectiveness of TACs have defined effects as the 
number of services provided (e.g. , workshops, consultations), as the 
number of clients served, or as the number of client contact hours. Such 
studies substitute as the criteria for judging cost-effectiveness, the 
easily quantifiable means of providing service (i.e., consultations, 
workshops, etc.) or, at best, the nominal effects of service (i.e., 
clients served and contact hours) in place of the true goals of 
evaluation technical assistance. He states that these criteria could 
easily be viewed as input measures rather than as effects or outcomes,, 

Estes lists six additional criteria that represent the goals of technical 
assistance as: number of reports turned in to the states by districts; 
number of districts included in the state report; number of instances in 
which services result in program modification or in a particular 
evaluation approach being tosed; extent of client satisfaction with TAG 
services;, amount of local capacity built; spin-offs such as better tests 
or testing practices, and other programs using materials or ideas. He 
goes on to say that the number of reports and the number of districts are 
quantifiable and could be collected. It is also possible that the number 
of instances of service impact or the extent of client satisfaction could 
be quantiried albeit with greater eJfort and possibly less reliability. 
Other criteria might also be scaled and collected. 

Estes provides an extensive example of how one might determine cost- 
effectiveness if workshops, consultations, phone calls, *tc, were viewed 
as the inputs for producing effects which were measured by criteria 
related to the goal of getting clients to attempt a process evaluation 
using a handbook. Such an approach would providfe much needed information. 

In conclusion, he notes thecs (a) it is critical to be informed with 
data about where and how costs are distributed for a program; (b) an 
explicit agreement on the effects and criteria for effects is necessary 
if a program is to know how to place priorities jmong goals and 
objectives; (c) using information from (a) and (b) in making programmatic 
decisions will improve efficiency in accomplishing gbals; (d) like 
evaluations, cost-effect studies will be only one piece of information 
which is used in decisions to continue, discontinue, or modify a 
program. 

More information abou^ "Cost -Effectiveness in Evaluation Technical 
Assistance: Different Aspects of Measuring Cost and Outcomes, 11 may be 
obtained from Gary Estes, Director, Evaluation and Assessment Program. 
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TAC ACTIVITY INCREASING IN 
THE AREA OF COST ANALYSIS ' 



The chapter 1 Evaluation Technical Assistance Center (TAC) has recently 
engaged in three activities aimed at improving cost-analysis skills among 
Chapter 1 personnel. 

• Cost-Analysis Workshop Offered 

in December 1983, a cross-section of Chapter 1 teachers and 

* administrators, state and federal Chapter 1 evaluators, and J 
Bureau of Indian Affairs personnel, were provided with an 
introductory workshop on cost analysis methods. The workshop 
was intended to introduce basic cost analysis concepts, 
provide a structured forum for exploring the ^possible 
advantages of cost studies, and help participants select 
appropriate cost methods. Participants reportedly appreciated 
the workshop, especially the use of the ingredients approach 
,to identifying program components". Additional cost analysis 
workshops are being planned to help Chapter 1 staff apply 
cost-analysis methods to specific Chapter 1 problems. 
Readers can learn more about the TAC cost-analysis workshops 
by talking with Jara Kay Smith, Technical Assistance Center. 

• Using Microcomputers as Tool for Cost-Analysis and 
Cost -Mode ling Studies 
The use of spreadsheet programs such as Multiplan and 
integrated software such as Lotus 1-2-3 are being considered 
in conducting cost-related sensitivity analyses. These 
programs offer a powerful way to test the implications of 
changing cost values aM assumptions. A practical applica- 
tion of these tools is in the assessment of national 
Chapter 1 cost and participation data. They may also be used 
to develop models which allow for different interpretations 
of the results of cost studies. Fot example, the effects of 
the following factors on the results of cost studies may be 
modeled using microcomputer-based spreadsheets and database 
programs: (a) different scaling properties of outcome data, 
(b) violations of scaling assumptions, (c) varying sample 
sizes, (d) different rates of inflation, and (e) price 
adjustments. Readers can learn more about the use of 
microcomputers as tools for doing cost-analysis and cost- 
modeling b< talking with Steve Murray, Technical Assistance 
Center . 
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• Evaluation Technical Assistance Staff Given 
Inservice on Cost-Analyis 
In October 1983, two training sessions were held for staff 
from the Region 2 Technical Assistance Center, representa- 
tives from the United States Department of Education. One 
session focused on cost-analysis as applied to Chapter <1 
ptograms, while the other session addressed the issue of the 
cost-effectiveness of TACs. As a result of the session, 
Region 2 is considering a needs assessment of SEA and LEA 
evaluators^ regarding their interest in cost-analysis 
training and technical assistance. For more information 
about other TACs 1 activities in the area of cost-analysis, 
contact Steve Murray, Technical Assistance Center, 



COST STUDY OP LOCAL SCHOOL DISTRICT'S 
INSTRUCTIONAL MANAGEMENT PROGRAM PROPOSED 

A proposal for doing a cost study of a computer-based instructional 
management system is currently being developed. The proposed study would 
assess the cost -effectiveness of a system which provides computer- 
generated printouts to teachers for the purpose of planning and monitoring 
students 1 programs. The system is based on computer scored and/or 
recorded tests and the resulting reports generated by the computer. A 
design combining cost-feasibility and cost-utility elements is being 
proposed since the data needed to conduct cost-effectiveness or 
cost-benefit studies are not available. The cost ingredients of the 
system have been identified as (1) cash costs such as teacher aides, data 
processing, and the program coordinator, and (2) non-cash costs such as 
teacher and schoql level 'administrator time. The value of the outcomes 
of the system (i.e., instructional management information) will be 
assessed by having teachers, principals^ district administrators, and 
other staff "srp^nd" a hypothetical "budget" of $100, $1,000, or $10,000 
on various outcomes. For more information on this proposed study, 
contact Bill Savard, Evaluation and Assessment Program. 1 



SHARE YOUR COST RELATED WORK 



If you are engaged in any studies, technical assistance, or other 
activities that involve cost analysis, share your insights, problems, or 
results with C0$T COMMUNIQUE readers by letting Petfer Gray (ext. 387) 
know. 



CO$T COMMUNIQUE is a periodic internal publication from the Research on 
Evaluation Program, Northwest Regional Educational Laboratory. Questions 
concerning CO$T COMMUNIQUE should be directed to its editor:^ Peter J. 
Gray ^extension 387) . 
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FOUR DIFFERENT APPROACHES TO COST ANALYSIS 

Coat analysis as envisioned in this newsletter can be a formal or an 
informal activity based on academic, cost analysis techniques or on 
practical budgeting and accounting methods. As we reflect on out 
experiences in confronting cost related problems in school districts and 
other real settings , ,it is clear that in many cases formal techniques are 
more appropriately seen as hueristic devices rather than as prescriptive 
procedures. This newsletter is dedicated to the recognition that costs 
play an important role in program evaluation. 

In this issue, four practical uses of cost analysis are described. Threv 
of them *4re related to Chapter 1 technical assistance work and the other 
is related? to a program evaluation contract with a school district. 

The first Chapter 1 example demonstrates microcomputer based analyses of 
comparative cost effectiveness data. The microcomputer is shown to, be a 
valuable and powerful tool for cost analysis*. The second Chapter 1 
example concerns the relationship between changes in .funding at the 
national level and the extent and type of services provided to Chapter 1 
students. The relationships demonstrated have evaluative implications, 
but the analyses do not fall precisely under any of the four cost 
analysis methods, namely* , cost feasibility, utility, benefit, and 
effectiveness. Nonetheless, they are valid uses of cost analysis 
concepts. The third Chapter 1 example describes a workshop on cost 
analysis that is currently being offered for school admioistrators. Its 
purpose is to help them apply streamlined cost analysis techniques to 
everyday problems. The final example of cost analysis concerns the cash 
and non-cash costs Associated with a computer based instructonal 
management system- In this case, cost data are used to illustrate where 
program improvement may roost appropriately focus. 



ANALYZING COST EFFECTIVENESS VIA MICROCOMPUTER 

Chapter 1 projects may have many different configurations in regard to 
the use of aids, materials, and other resources. Various configurations 
may result In different start up and operational costs, average normal 
curve equivalent (NCE) gains, and cost effectiveness ratios. Steve 
Murray has developed the following tables to illustrate how presenting 
data about these resulting factors in varying formats can help one 
interpret the cost effectiveness of different Chapter 1 programs. 
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t 

The general format of each of the preceding tables is the same. That is, 
they each represent a summary of project costs and outcome information. 
The project code letters are listed down the left side of the table 
followed by the comparable cost per student in, the form of acquisition, 
operational, and total costs. ' Next, ,the average pre- and poat-NCB score 
and NCB gain for each project is listed. Finally, in the far right 
column the cost effectiveness (C/B) ratio is shown. This ratio is the 
result of dividing the total cost per student of each project by the 
average NCB gain. What differs in the four tables is the way the data 
for the projects are sorted. 

Using a microcomputer based spreadsheet program like SuperCalc or an 
integrated program like Lotus 1-2-3, it is possible to enter the data 
needed to set up the first table* where the projects are simply listed in 
alphabetical order. This layout is useful in that it is relatively easy 
to find a particular project, but it is not so easy to compare projects 
in terms of total cost, average NCB gain, or C/B ratio. With programs 
like 1-2-3 and SuperCalc, one can sort the data used to set up the first 
table by these other areas. The resulting formats are shown in tables 2, 
3, and 4. Using these tables one can easily find the programs that are 
least expensive /have the greatest NCB gains, and/or achieve the lowest 
C/E ratio. The advantage of using a microcomputer for such analyses is 
that once the data are entered, the generation of any of a variety of « 
tables is left up to the software program and no additional work is 
required of the user except to, specify the type of ordering to be 
performed. This is far less labor intensive than having to hand-type 
each new table. , 

In addition to being a convenient way to organize the presentation of 
comparative cost* data, the microcomputer can also help one to better 
understand the limitations of cost effectiveness comparisons. Using 
another set of data, Steve Murray has produced the following table to 
show how sample size and the related margin of error in NCE gains can 
influence cost effectiveness estimates. 

The implications of using different estimated gains (low, middle, and 
high) based on the error associated with different sample sizes are worth 
noting. Using the low cost effectiveness estimate (i.e., cost per 
student/ reported NCE gain + NCE error) the projects fall into the 
following order: B($67), A ($87), C ($92), E ($111), D ($130). The same 
order is obtained using the middle estimate (i.e., the one listed in the 
table): B ($111), A ($133), C ($167), E ($175), D ($225). However, using 
the high cost effectiveness estimate (i.e., cost per student/ reported 
A NCE. gain ,-' NCE error),, the order of most cost effective to least cost 
effective program changes entirely as follows: A ($286) , B ($316) , 
E ($422) , D ($844) , C ($913) . Clearly, one should consider the effect of 
measurement error when comparing programs' cost effectiveness. 

For more information on the use of microcomputers in doing the kinds of 
analyses shown in these tables and on their implications, contact Steve 
Murray, extension 404. 
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COST-EFFECT I VbNKSS ANALYSIS WORKSHEET 
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NCE Error: N(6) »+6.53; N(13) =+4.44; N(16) =+4; 
N(24) » + 3.27; N(30) - + 2.92. 



TRENDS IN TITLE I/CHAPTER 1 FUNDING AND SERVICE LEVELS 

The recent changes in authorizing legislation, from Tide I to Chapter 1, 
and th change in the overall appropriation to school districts have 
heightened interest in federally funded compensatory education. However, 
the sources of information useful in tracking such changes are often used 
in isolation from one another. And to date there are no comprehensive 
summaries of the various sources of information. As a result, the 
picture of what is happening in Chapter 1 is fragmented at best. 

A paper presented by Steve Murray at the Spring Conference of the 
Washington Educational Research Association aggregates existing data 
sources to address two policy questions of interest at the local , state, 
and federal levels. These questions are: 

1. How has the national funding level for basic Title 1/ 
Chapter 1 grants to districts changed since 1979-80? 

2. What are the associated national trends in Title 1/ 
Chapter 1 participation? 

•» 

The paper is a working document. It is suggestive rather than 
definitive; it outlines areas for study rather than closing off study. 
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Murray summarizes the conclusions of this paper under the following three 
topics : 

Funding level t When corrected for inflation (using annual 
increases in teacher and instructional aide salaries paid) , 
dollars appropriated to districts declined each year from 79-80 
through 82-83 with a slight increase in 83-84. By 83-84, the 
cumulative effect of appropriations from 79-80 amounted to a 
28.1% reduction in support for Chapter 1 programs. 

Participation from 79-80 through 81-82 ; Overall, the number of 
students served dropped tj 9.9%. However, in the aggregate, 
< districts have tended to reduce services disproportionately in 
high priority areas , (e.g. , reading and mathematics' programs and 
elementary programs) . The proportion of students receiving 
services in more than one program area may have also dropped 
slightly. 

Funding and Service ! The number of students served relates, on 
the average, to the overall budget cut. By adjusting for 
inflation and improving the validity of the data on students 
served, the relationship is closer to proportional than using the 
more superficial measures. Moreover , analyses show that using 
superficial indicators of funding and service underestimates the 
impact of budget cuts on Title I/Chapter 1. 

Murray states that the data are equivocal regarding the question as to 
whether the changes in funding and service suggest more or less efficient 
programs. He points out that the reduction in the number of students 
served from 79-80 to 81-82 was somewhat greater than the reduction in 
appropriations before correction for inflation. While this might seem to 
suggest less efficiency, correcting for inflation depicts what could be 
the opposite trend of increased efficiency. 

Noted in the paper are two reasons to be suspect of either conclusion. 
First, dollars appropriated, whether or not corrected for inflation, do 
not match dollars available for a given year as funds can be carried over 
or reallocated from the prior year. Adjusted dollars appropriated, thus, 
can be a misleading measure of support. It is reasonable to expect some 
school administrators to use carry-over to buffer significant cuts. The 
net effect of this carry-over management would be to delay or mask the 
effects of budget cuts. A second reason for not concluding that the 
schools were less efficient in 81 T 82 is the use of participant count as a 
measure of service level. 

In addition to possible changes in reporting practice from year-to-year, 
there is a more significant problem in using an aggregate count of 
participation as a measure of service level. Namely, there is no reason 
to expect the cost of services per student to be equal across categories 
of service or even across time. In other words, a count can have 
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different cost implications depending on the program, the service area, 
and the year in which the count is taken. A 1976-77 study of 
compensatory education program costs found, for example, that Title I 
reading programs required about 1.6 times more financial support than did 
Title I mathematics programs in grades 1-6. 

In general, this paper highlights the difficulties of using national data 
collected for differing purpose sf to answer speeific cost questions.. 
Murray does an excellent job of pointing out possible interpretation of 
the data while adding important cautions. 

COST ANALYSIS WORKSHOP 

A workshop on cost analysis for school administrators has beet) developed 
which provides an introduction to four coat analysis methods'. This 
workshop teaches skills needed for selecting the most appropriate cost 
analysis method to use in the evaluation of an educational programs 
Developed by Jana Kay Smith, thiu cost analysis workshop has been 
conducted in educational agencies in Arizona, California, and Colorado. 

The three-hour workshop begins with a discussion of the rationale for 
conducting cost analysis studies* The participants are introduced to 
potential applications of cost analysis methods, beginning with i 
discussion of eight common questions that can be answered by these 
— methods. These are questions often asked by administrators, program * 
coordinators , program participants, and even members of the community. 
For example, community members may ask, "What are we getting for our tax 
money?" 

Once' the purpose of cost analysis methods in educational evaluation is 
made clear, four methods, cost feasibility, cost utility, cost benefit, 
and cost effectiveness are defined in everyday terms* For example, the 
participants are encouraged to imagine themselves on a car lot looking at 
new pickup trucks. They are given the scenario that they have saved 
$6000 to buy a new truck (and don't want to use credit). They see 
Truck A for $5500 and Truck B for $7500. Which purchase is feasible 
within their financial constraints aid which is t not? Obviously, it is 
feasible to purchase Truck A, This is an example of coot feasibility 
reasoning. 

Suppose, however, the participants wanted to go beyond feasibility and 
try to get the most for their money? If hey were in farming and wanted 
the truck to haul hay, they might look at the power of the trucks. In 
this case, Truck A will haul up to 3 tons of hay, while Truck B will haul 
up to 9 tons of hay. By comparing the oust of the trucks to their 
hauling effectiveness, you can see that it will cost $1,833 (5500/3) to , 
haul a ton of hay with Truck A, compared to only $333 (7500/9) to haul a 
ton of hay with Truck B. Clear 1;/, Truck B is the most cost effective 
selection* 
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After the participants understand the difference between the four cost 
analysis methods, examples of applications of these methods to 
educational evaluation are described. A flow chart is used to dnineate 
the steps of method selection* 

The workshop concludes with a discussion 0 of methods of "streamlining" the 
steps of valuing ingredients and measuring outcomes. For each step, a 
minimum of four streamlining techniques are offered. For example, in 
some cases, only the largest ingredients might be listed, or already 
collected measures of outcomts may be used. The effect of each 
streamlining technique on the reliability and validity on the study .is 
emphasized and participants are- encouraged to consider adopting any of 
the streamlining techniques only with caution. 

Development of the workshop was funded by the Region 4 Chapter 1 
Technical Assistance Center and the Research on Evaluation Program. For 
more information about the cost analysis workshop, contact Steve Murray. 

PROGRAM EVALUATION/COST ANALYSIS COMPLETED 

Bill Savard has completed a study of the co sts and associated ef fects of 
a math and reading objectives based instructional management system. The 
intent of the study was to provide information to school district 
decision makers regarding the system. A major portion of the study dealt 
with finding cut the feelings about the program on the part of the people 
associated with it (including teachers, principals, and aids). In 
general, the program has the support of most of those involved, although 
approximately 60% of tlie regular teacher «. and 44% of the Chupter 1 
teachers see problems with it at present. 

These results suggest tsat the system sftould be retained but that changes 
should be made. Cos - data were reviewer! first to determine whether the 
cost per student for the system was reasonable and second to determine 
what monetary impact changes might have. Costs were broken out item by 
item to determine per child costs. 

In order to calculate per child cost*, Savard used the average daily 
membership (ADM) figure of 8,587 for 1932-83, for grades 1-6, supplied by 
the district. Average daily membership is usually higher- than average 
daily attendance (ADA) but lower than total enrollment and perhaps 
provides the most realistic base for calculating per child costs. The 
overall per child cost was $55.62. Of this amount, approximately $1.66 
is attributable to che district office, $48.06 to the school level, and 
$5.90 to data processing. Within the data processing costs, $.70 per 
child was for paper, forms, answer sheets and other supplies. Within the 
school level, cost was $12.06 per child for aiden and $31.23 for teacher 
time. 
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Examination of the various coat categories reveals that some can be 
described as cash costs, others as non-cash costs. Cash costs can be 
defined as being directly attributable to. the program and which could 
reasonably be expected to be saved if the program were eliminated. 
Non-cash costs are defined as being either directly or indirectly 
attributable to the program, but which could^not be reasonably expected 
to produce cash savings if the program were eliminated. 

In summary, it would appear that the system costs about $477,644 per 
year. About a third of that, $151*149-* is made up of cash costs. This 
amounts to about $17.60 per child. The other two-thirds of the total 
consists of non-cash costs, costs which would remain even if the program 
was eliminated. Several non-cash cost categories were identified that 
deserve particular scrutiny, including district office staffing (perhaps 
not enough), principals' time (perhaps not enough), and teacher time 
(perhaps not used efficiently) . Making changes in such non-cash cost 
areas would not result in budget increase. 

Savard has effectively united program evaluation and cost analysis into a 
synergistic whole. This has been achieved by looking not just at the 
reasonableness of the costs of the system but also at the cash and 
non-cash costs of the system and then rel&w<ng these to potential 
modifications of the system suggested by input from those associated with 
it. For more information about this study, contact Bill Savard, 
extension 342. 



CO$T COMMUNIQUE is a periodic internal publication from the Research on 
Evaluation Program, Northwest Regional Educational Laboratory. Questions 
concerning COST COMMUNIQUE should be directed to its editor: 
Peter J. Gray (extension 387) . 
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Three studies are reported in this issue of the CO$T Communique. The 
first is a study of state education agency (SEA) evaluation units 
regarding their past, present, and anticipated future uses of cost 
methods. The second is a similar study of local education agencies 
(LEA) • Both of these studies were conducted by the Research on 
Evaluation Program. The third study focused on alternative Chapter 1 
elementary reading programs. It was conducted by tha Assessment- and 
Evaluation Program. 



SEA STUDY 

Of the SO state departments of education contacted in this study, only 37 
had centralized evaluation units in 1983 and 29 of them (78%) responded 
to our questionnaire. Although a few evaluation units had done as many 
as a dozen cost studies in the past five years, the mode was clearly 
zero. Single program cost descriptions and cost-feasibility analyses ' 
were the most commonly done studies. Although the number of studies done 
was low and the methods used Were relatively simple, the units doing cost 
studies reported being pleased with the impact of their efforts. 

Surprisingly, 48 percent of the units said there tas currently a formal 
expectation or requirement that they do some form of cost analysis work 
and they estimated devoting an average of 11.5 percent of their budgets 
to cost work. Fifty-nine percent of the units anticipated having a - 
formal requirement to do cost studies in the next five years and expected 
to spend an average of 17 percent of their budgets for that purpose. 

When we asked why the units were not currently doing more cost studies, 
some respondents said that they were simply not being asked to do them. 
Most respondents, however, said that it was difficult to relate cost data 
to educational outcomes and that they had few examples, texts, or 
guidebooks to follow in conducting cost studies. 

The evaluation units did expect to be using a wider range of cost methods 
in the future, especially cost-utility analysis and cost-feasibility 
analysis. Pew of them expected to be using the more complicated methods 
which include actual comparisons of costs with outcomes, such as 
cost-effectiveness and cost-benefit analysis. 

When we asked why they didn't use cost-effectiveness analysis more (the 
theoretically best method for this work) , they reported either not 
knowing much about it or thought it was simply too complicated. « 

Por more information, contact Nick Smith, Research on Evaluation Program. 
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LEA STUDY 

Of the 67 metropolitan school districts surveyed in this study, 52 (781) 
completed the questionnaire. Most evaluation, units had had seme 
experience with cost analysis methods, particularly with coat 
descriptions and cost feasibility analyses. Although, in general, the 
number of studies done was low and the methods used were relatively 
simple, the units doing cost studies reported being pleased with the 
impact of their efforts. 

At the time of the, survey, 21 percent of the units said there was 
currently a formal expectation or requirement that they do some form of 
cost analysis work, and they estimated devoting an average of 3.3 percent 
of their budgets to cost work. When asked to project future requirements 
to conduct cost analysis work, 71 percent anticipated having a formal 
requirement to do cost studies, and expected to spend an average of 
9 percent of their budgets for that purpose. Clearly, the respondents 
anticipate conducting more cost studies in the fucure. 

The impediments or problems in conducting cost analysis studies were also 
investigated. It was evident that as experience increased (measured as 
total number of cost studies conducted in the past 5 years) , the 
impediments or probltmm in implementing cost studies decreased. Since, 
the number of cost studies conducted by school districts is expected to 
increase over the next few years, we would expect evaluators to have 
fewer problems in doing cost studies. 

For more information contact Nick Smith, Research oh Evaluation Program. 

ALTERNATIVE CHAPTER 1 PROGRAMS 

This study concerned an evaluation of three alternative remedial reading 
programs used at the intermediate level in Chapter 1 programs. Three 
elementary schools were involved in the study. The three instructional 
programs were: 1, computer assisted instruction! 2, computer managed 
instruction; and 3, an individualised instructional program guided by 
reading specialist without use of computer technology. A cost benefit 
study was commissioned to determine the relative merits of the three 
instructional approaches. 

The purpose of the study was to document the relative costs, utility, and 
benefits to identify which program provides the greatest benefit per 
dollar. In this instance, the effectiveness in increasing student 
achievement was equal for the three programs, while the costs varied a 
great deal. On this basis alone the traditional program was the most 
desirable. Other utility considerations such as curriculum alignment and 
skill mastery rates suggest that the computer managed instruction program 
was also worth further consideration. 
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No. 6* November 1984 



The computer assisted program is effective end received good ratings of 
quality and utility. Unfortunately* it is both costly and has poor 
alignment with the district's adopted reading curriculum. Other 
evaluation information/ such ae student attitude* was not collected for 
this study* which might have supported the program. This study 
illustrates the breadth and depth of information that can be added to an 
evaluation through cost analysis methods. 

For more information contact Steve Nelson* Assessment and Evaluation 
Program. 



EDITOR LEAVES 

With this issue of the COST Communique I leave the Laboratory to assume 
the position of Associate for Evaluation at Syracuse University. Please 
feel frei to contact me ats 

Pet?r J. Gray 

Syracuse University 

Center for Instructional Development 

115 College Place 

Syracuse* N. Y. 13210 

(315) 423-4571 



COST COMMUNIQUE is a periodic internal publication from the Research on 
Evaluation Program* Northwest Regional Educational Laboratory. Questions 
concerning COST COMMUNIQUE should be directed to Program director Nick 
Smith (extension 384). t 
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MATERIALS FOR A WORKSHOP ON USING 
MICROCOMPUTERS IN EVALUATION AND ASSESSMENT* 



' * INTRODUCTION 

The purpose of this workshop is to introduce perticipants to ths many and 
varied uses of microcomputers in evaluation. Microcomputers may be 
thought of as very powerful all purpose tools. They can be of benefit at 
every- stage of the evaluation process. As shown in the figure below, 
they can be used from proposal writing and planning to reporting. 

ihe diversity of software programs which have specific uses is what makes 
microcomputers so versatile. With word processing programs a computer ~ 
can be used to create, edi,t, and print textual material." with electronic 
spreadsheets and statistical programs computers can be used to record, 
manipulate, analyse, summarize, and report numbers, with graphic 
programs computers can be used to commmunicate information in visually 
attractive and understandable ways. 

Each of the major types of programs listed below is described in this 
booklet. Those descriptions consist of a discussion of the concepts 
related to each program type, a sample of representative commercially 
available programs, and a list of references for more information. 



SUMMARY OF EVALUATION USES OF MICROCOMPUTERS 

Word Data Test Calc/ Graphic Telecom/ 
Activities Proces. Bases Genera, atats Present. Network. 



Proposals & 

Planning x X XXX 



Management X x X 1 



x 



Data 

Collection XX X 

Data 

Analysis X x x 

A. <W 

Reporting X XX 



♦Adapted from Research on Evaluation Report No. 89 of the same 
titlv by Peter J. Gray and Dennis Deck, Northwest Regional 
Educational Laboratory, Portland, Oregon, November 1983,. 
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WORD PROCESSING 



The main concept behind word processing is the notion of a document , . 
that is, a letter, book chapter, entire report, proposal boiler 
plate, or any discrete body of textual information. The creation of 
such a document starts with the use ot*a keyboard, more or less like 
a standard typewriter, to snter the text into the word processing 
system. Formatting, editing, merging, and printing are the four 
things that a word processor has to offer in addition to simple 
typing of text. 

Formatting 

\ 

There are some features of .word processors which help to arrange 
words on a page as a document is created. Formatting refers to the 
arrangements of the words themselves. Like a typewriter, a word 
processing program allows you to indent the first word of a paragraph^ 
or to* tab trie headings and subheadings of an outline. It is possible 
to automatically center headings. Whole blocks of text can be 
indented and single spaced. In fact, the spacing between lines can 
be altwred by using the return key jus,t. like on a typewriter. In 
addition, some word processors allow automatic underlining, 
subscripts , and superscripts , special features include the creation 
and editing of multi-columns of text or tabular information and the 
creating of footnotes . 

Editing * . V* 

Once text has been entered, extra letters, words, and so on,, can be 
inserted or deleted without having to retype the surrounding text. 
The word processing program automatically rearranges the text to 
accomodate these changes. In fact, words, phrases, sentences, and 
whole blocks of text may also be moved from one part of the document 
to another if the order of things needs to be v changed. 

Another interesting feature of most word processing programs is the 
ability to search for a particular word, such as one that may have 



been consistently misspelled. With most wordorocessors it is 
rare±fa l B to a uto ma t i c ally replace o n e word with an o ther on e , such 



-SUB- 



the correct spelling of a misspelled word, wherever it occurs. 

There are even programs called spelling'checkers whichiare electronic 
dictionaries. They "look at" each word in a document and check to 
see if it matches the words in the dictionary. ' If not, the worddis 
presented for a decision about its correctness. Still more 
sophisticated are programs that check for diction, style, and clear 
wording such as the one being developed by Bell Laboratories. 
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Merging 

Since word processed documents are stored electronically, it is 
usually possible to combine them in various. ways. The simplest 
way is to attac h one document to another. For example, the parts 
of a proposal that were created as separate documents can be 
linked with a standard institutional description and disclaimers* 
without having to retype or cut and tape them into place. Whole 
letfcsrs may be built of smaller blocks selected from a variety of 
paragraphs that provide different options for reporting results 
to various audiences. Old text may also be merged with new text 
as when a standard letter is customized by adding a unique 
beginning and ending, or by searching and replacing a symbol 
(such as "*"/ with the name of a particular person. In this way, 
names, addresses and text can be merged to produce personalized * 
form letters. 

Blank forma such as activity logs can also be created and stored. 
They may be retrieved and completed for individual events and 
than stored again. At the end of a project the logs may be 
printed to document the activities which took place. 

Printing . 

Some of the formatting features described above may have already 
set the general layout of ^a page, but with many word processors', 
final choices are made at the time of printing as to where the 
text is to appear on the printed page. 

The first concept here is margin , that is, the blank space at the 
top, bottom, left, and right of the words. In most word 
processing programs you set the margins at values which are Vsed 
most commonly (for example, letters or manuscripts) , and only 
make changea for special cases (for example, outlines). When 
printing a document one must also decide if the text is to be 
right justified , that is, whether the words are %o line up on the 
rlgnc side of the page in a straight line as they do on the left 
side of the page. 

» 

H es d e r e and f oo t e rs which do not appear in the text mav be~addecrr~ 
at the time of printing. Page numbers may also be added 
automatically at the top or bottom of the page by the program as 
the document is being printed. 

Spacing between th» lines of text is often chosen at the time of 
printing (i.e., single space, double space) . It is also possible 
to adjust the number of lines of text on a page, or to put it 
another way, to decide where each page stops, so that there are 
no widows or orphans at the top or bottom of a page. 

In summary, word processing programs provide flexibility in the 
organization of text from its initial* typing, to editing, to 
merging with other text, to printing. 
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A Sampler of Word Processing Programs 

The programs presented in the following table are just a sample 
of the nearly 100 word processing programs available. There are 
many competitor a , especially at the middle and upper price 
ranges. The articles in the reference listPprovide detailed « 
evaluations of programs in terms of their specific features. 



Program Company Cost System Comments 

Bank Bruderbund $70 Apple The Volkswagon of word 
Street processing programs. This 

Writer menu driven program is ideal 

for draft production and other 
every day uses. 

Pie Hayden $150 Apple Has many features of more 

Writer sophisticated programs, but 

it takes some practice to 
be able fco "»se them all. 

Electric IJG $86 TRS-80 J,ike Pie Write, a good low 

Pencil Computer cos* ystem. This one for 

. Services TRS--0 machines. 

WordStar Micro $495 CP/M The top of the line program 
Pro IBM with most of tlua features of 

professional word processors. 

« 

* References 

Chin, K. s Shea, T. Guide to word processing programs,. In f oWorld , 
January 17, 1983, 5 (3) . 

Chin, K. 6 Shea, T. IW keeps it promise: Add these to your WP 
list. Inf eWorld , March 28, 1983, 5_(13) , 65-67. 

Gabel, l). Word proces ling Apr personal computers. Personal 
Computing , August 1982, 82-87; 92-95; 97-98; 102; 106. 

Heintz, C. Buyer's guide to wotd processing. Interface Age , 
December 1982, 40-42; 46-48; 50; 55-58. 

Mart611aro, J. Introduction to word processors. Peelings II , 
4(6) , 36-37. 

Martellaro, J. Word processor wrap-up. Peelings II , 4_(6) , 
57-67. 

Perry, R. L . Word processing: the A to Z of software. Personal 
Computing , March 1982, 72-73; 78; 80; 82-83; 87-88; 98; 100; 
104. 
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DATA BASE MANAGEMENT 



A microcomputer data base may be thought of aa an electronic filing 
system. Like a paper filing system, a data base consists of a 
consistent set of records . . Each record is a completed form and on 
each page of the form there is specific information. The items of 
information on the page are called fields . For example, the first 
page of a student data base might have fields which contain an 
identification number, the student's last name, first name and middle 
initial, the student's grade, teacher, and school, sex and racial 
datap and any other demographic information needed. The aecond page 
of al student data base may have a set of test scores over a number of 
years. The third paqe may have parent information; auch as parents' 
names, work and home addresses, and so forth. Togetter, the 
completed pages of this form make up one student record, and all of 
the student records created using this form constitute a file . 

Let's look at the general characteristics of data base management 
programs. 



Function! 

Programs: 
Advantages: 



Facilitates the storage, retrieval, and 
repotting of information 

***** 

<=PFs File, OB Master, dBase II 

Handles many kinds of information 
Vjry flexible can be used to create many 
different files (e.g., student record j, 
personnel records, equipment inventories) 
Easy to maintain information by editing , 
deleting, updating, sorting', and indexing 
records 

Can be used to retrieve information about 
individual records ok about groups of 
records meeting certain criteria 

Requires considerable time to set up 
Requires time to learn the operation of the 

more complex programs 
Limited statistical analysis'") 
Requires trained personnel to maintain the 
data base 

There are three sets of concept related to data base management that 
will help you understand what data bases are and what they do. One 
set concerns setting up a file. Another set has to do with how to use 
a data base management system. And the third set concerns generating 
reports. 



Disadvantages: 
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setting ue a file 



There is a considerable amount of planning that has to be done so 
that <1) the creation of a data base can be accomplished in an 
efficient manner and (2) the data base will have maximum 
utility. The first step is to decide how the file is to be 
organised) that is, what the primac^cey is to be. The primary 
key has the same relationship to.a^Wa base that a main entry 
card catalog has to a library. The "records" in the library are 
organized by some shelf location code. This code consists of an 
indicator for the subject area, a code for author's last name, 
the publication date, a title code, the copy number, and so 
forth, until that "record" is uniquely identified. Similarly, 
the primary key is a code for each record in a data base. It may 
be as simple as a Social Security number or it may be more 
complex and, for example, consist of last name, first name, and 
birth date. 

It is often the case that records are not entered in primary key 
order. For example, the students in grade one aay be entered 
after the students in grade five, even though their 
identification numbers come earlier in the sequence. The primary 
key is used by the program to find each record. The shorter the 
key, the quicker the program will be able to operate. Of course, 
there are many ways to organize the records in a data base. In 
fact, they may be sorted according to any of the fields in a 
record. These other organizations are called secondary keys and 
are very helpful if the user wishes to review a group of records 
organized in a particular way, say, by zip code and in 
alphabetical order by parent's lasi name. 

Once the primary key has been established, the next step is to 
lay out the rest of the fields in a record. These can be 
alphabetic, numeric, or special fields, such as yes/ no, social 
security, telephone, date, and so on. The fields or a record 
should be organized into logical sets and may \e allocated to 
separate pages if necessary. The final step in creating a data 
base is to determine the format which will insurants utility. 

In many cases the data base will be created as you specify the 
fields on each page of the form. Therefore, it is important to 
have a good idea of the physical layout of the screen pages, the 
basic characteristics of each field (i.e., the type of 
information and the amount of space to be allocated to it in the 
data base), and the special characteristics of each field (e.g., 
primary key, computed) . Then you can follow the program 
directions on the actual setting up of the data base. 
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using a data bass ' 

Once a file has been created it nay bo put to many uses. The 
initial use is to add records . When this choice is made, the 
program will typically display a blank first page of the data 
base form.. The user simply begins entering the information field 
by field. Let's look at a couple of ways to save time when 
entering information into a data base. 

There are times when you will not want to enter all of the 
information in a data base at once. An example might be when the 
test scores from the second year of a five-year program are 
ready. It would be a waste of time to have to move page-by-page 
and field-by- field through a form to get to the appropriate 
place, instead, it is possible to extract just those fields 
needed to identify each record (i.e., the primary key) and those 
fields that need to be changed and to put them together into an 
abbreviated form. When data are entered and saved, they are 
inserted into their proper place in the larger record. 

■ 

Another way to speed data entry is to use default values. These 
can be specified at the time when the data base is first 
created. Default values are those that will be used again and 
again, for example, a particular telephone area code. In other 
cases, temporary default values might be specified when a set of 
records are being added, for example, all of the reading scores 
for the thir i-graders in Crest Drive School., A good data base 
management program will facilitate the entry of data by allowing 
you flexibility in formatting the pages in your form, by giving 
you the option of creating short forms, and by providing you with 
the ability to set both permanent and temporary defaults. 

After records have been entered, it is then possible to search 
for a particular record or a given set of records. In some 
programs, an extensive list of options for searching the data 
base is available. For example, you may wish to search for 
records which fall within a certain range such as Aa to Cz. or 
there may be a need to find all of the records which start with a 
particular prefix, such aa NWRELXXXXX. Sometimes records with a 
particular string of letters or numbers are desired, as in a 
search for all of the materials which include the word 
microcomputer, when the exact spelling of a word is not known, a 
search can be conducted which will find any word that has all the 
letters except the unknown ones (e.g. , GR?Y) . All of the 
relational signs can also be used to direct a search, 
including: <,7, and their various combinations. 

Often these different types of searches can be linked together by 
an AND or an OR condition. For example, you might want to 
specify two discontinuous ranges. In this case you would simply 
indicate the first range and then link it to the next one with an 
OR statement. 
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Having found an individual or group of records, it is then 
possible to edit or delete then. Deleting simply removes the 
record from the data bade. Of course, you must Le sure that you 
want the record deleted. It is often a good idea to have archive 
files of old versions of a data base with records that have since 
been deleted, just in case you wish to retrieve them at some 
later date. 

Editing a record means cqrrecting, updating, or adding 
information. Using a short form is a convenient way to edit , 
records. For example, a short form that just has grade level, 
new clasrtbom assignment, and end of the year test scores can be 
used to quickly update student records. Often you may want to 
send the edited record directly to a printer so that you have a 
typed copy. There are, however, more sophisticated ways to print 
out the infomation in a data base. 

Printing Reports 

Generating an interesting and informative report i'S one of the 
most exciting and rewarding uses of a data base management 
system. There are four different formats hai have to be 
specified in creating a report, namely, page format, data fqrmat, 
sort format, and select format. They form the column headings 
for the following table with their respective sub-formats falling 
under each heading. 



Page Format 

page 

numbering 
report dating 
lines/page 
continuous/ 

single sheet 
lines between 

records 
labels 



Data Format 

comment lines 
column titles 
computed fields 
data fields 
comment fields 
horizontal sub- 
& grand totals 
record numbering 
code fields 
report width 



Sort Format 

sort fields 
subtotal 

break fields 
page break 

fields 
(column 

totals)^ 



Select Format 

record 
chacter iatics 

(range , 
includes, 
starts with, 
relationals, 
AND / OR 
conditions) 



Creating a good report takes as much planning as setting up the 
data base to begin with, but once it is created you can use it 
and/or its parts again and again. 
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Summary 



Data base management packages ace one of the more useful tools 
available in the microcomputer toolbox. A good strategy for 
developing an understanding of how these programs work is to 
start with a simple one like VisiFile or PFS File. As you gain 
experience in designing more demanding data base applications, 
you will outgrow these progress and look for a package with the 
extended capabilities you now need. 

To design an application, try the following process * 

l « P«term f ine your goals . Be clear about what you want to 
accomplish with the data bane. 

2 * Specify the data needed . Sketch the types of reports you 
expect from the data base. Develop a list of needed 
fields, consider the requirements of each field. 

3. Design the reports . Refine the sketches of reports and 
layout on graph paper. 

Set up the data base . Enter the data base as you have 
designed it. Enter some sample cases and format some 
simple reports. 

5. Revise . Learning from your initial mistakes, start over 
with an improved design. Repeat as necessary. Now 
format the standard reports you designed. 

6. Pilot test . Os e the data base on real data for a period 
of time. Manually confirm that the results are correct. 
Plan on revising again. 

Three olanning aids are attached at the end of this section: 
data base planning checklist, data base estimation worksheet, and 
a summary of software specifications. 

Available Software 

There are perhaps a hundred different data base management 
programs available on the market, ranging in price from ten 
dollars to over a thousand. Obviously, all data base programs 
are not created equal, it is useful to distinguish between three 
types of programs: file management programs, true data base 
systems, and text-oriented data base programs. 

File management programs can only access information from a 
single file at a time. .This is fine for a simple mailing list 
but not for an accounting system that must keep vendor 
information in one file and detailed information about specific 
orders in another. These programs are typically easy to learn 
and use but are limited in the amount or type of information they 
can store. 
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On large mainframe computers, data base programs must be able to 
access the information you Want, even if the data are maintained 
in different files. For example, the.request "please list the 
addresses of students who were in Chapter 1 last year and scored 
below the 35th percentile" would require data from an address 
file, a Chapter 1 participation file, and a test score file. 

File management and data base programs usually limit the size of 
a field to less than 256 characters or the record to less than 
1000 characters. That is adequate for most applications, but not 
if more than a sentence is required for any one field. A 
text-oriented data base allows fields to be a single word or a 
whole page. It is usually possible to search the data base on 
key words. Those data bases are well suited for maintaining 
research notes, observations of students or staff, or 
bibliographies. 

Some popular programs include: 



Program 
Visifile 



Vendor 



Cost System* Type 



VisiCorp $250 Apple 



file 

management 



Comments 

easy to .use but 
limited capa- 
bilities 



PFS File Software $125 Apple 
PIS Report Publishing IBM 



file 

management 



easy but 
limited, need 
both programs 



DBMaster Stoneware $230 Apple 

IBM 



file 

management 



many features 
but a little 
difficult and 
tedious to use 



Infostar MicroPro $500 CP/M features 

IBM of both 



sophisticated 
data entry and 
report genera- 
tion features 



dBASE II Ashton- $700 CP/M 
Tate IBM 



database 
management 



great flexibil- 
ity with built- 
in language, 
programming 
skills 
recommended 



Datafax 



Link 
Systems 



$250 



Apple 
IBM 



text 

oriented 



aasy to use, 
free form input 
like a manual 
filing system 



* Apples and certain ether microcomputers can run CP/M software 
with the addition of a special circuit board. 
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INSTRUMENT QBMERATION 

A good instrument generation program should have the following 
characteristics: 

• easy text entry and editing for item creation and 
modification 

• convenient and safe data storage so that items can 
be quickly manipulated and reliably saved 

• simple item retrieval to facilitate the development 
of a complete instrument 

e flexible printing options for generating 

instruments, including lastrminute editing of 
items, as well as the creation of headings and 
special directions 



Text Entry 

Flexibility in text entry is the key characteristic that a 
program needs in order to ease the task of developing items. A 
good program will allow both immediate modification of items and 
modification subsequent to their creation. Modification might 
include altering an item by: 

♦ 

• inserting or deleting material 

• reformatting 

• adding options (i.e., responses) 
e changing the item's descriptors 

These characters facilitate the continuing improvement of items 
throughout the life of an item bank. 

Another important aspect of flexible text entry is the variety of 
item formats that are allowed. For example, programs differ in 
their ability to handle true/false', multiple choice, matching, 
fill-in-the-blank, or essay items. 

In addition to item type, the provisions made by a program for 
the inclusion of pictorial material is one that must be 
considered if such material is critical to the nature of an 
item. Picture*, diagrams, formulas with subscripts and 
superscripts, .nd special symbols are almost impossible to save 
in machine-readable format. *oout the only ways to overcome this 
limitation are (1) for a program to allow one t6 add a reminder 
to an item that pictorial material is to be included at the time 
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of printing, and (2) for the program to allow designation of th\ 
number of line feeds to follow an item so that room is provided - 
for the material. 

Item Storage and Manipulation 

Safe item storage is related to a program's ability to verify new 
material before it is written to disk and to check before items 
are saved to insure that another set with the same name is not 
inadvertently destroyed. 

There are two ways to handle the storage and manipulation of test 
items. One way is to allow the creation of a large number of 
items, limited only by the capacity of the at xiliary storage 
medium, such as floppy disk drive. In this case, items are 
manipulated by transferring as m*ny as possible to random access 
memory (BAN) and gradually working through the item bank. The 
drawback here is the time needed to transfer items back and forth 
from auxiliary storage to RAM. 

The other way to store and manipulate items is to limit each file 
to as many items as will fit in RAM at one time. This makes for " 
faster manipulation of a given set, but, of course, the set is 
smaller than a file whose size is related to disk capacity. And, 
it items from separate sets scattered throughout a disk are to be 
'manipulated, then the task can be even more time consuming than a 
similar task performed with a program which is based around disk 
storage limits. 

Some programs that are RAM based provide for the merging of 
subfiles into larger units, and for breaking bigger files into 
smaller ones. This can facilitate the task of manipulating a 
given set of items. 



Item Retrieval 

The simplest method of retrieving items is to assign each one a 
number as it is created. Then, using a master printout, one can 
locate and call up each item by its number in response to a 
prompt provided by the program. Another way is to be able to 
display items on the screen in numeric order and to be able to 
press a single key to identify an item to be selected. For large 
item banks, the use of item descriptors can help to narrow down 
the number of items to be reviewed in order to identify those to 
be selected. For example, descriptors might refer to (1) type of 
item (i.e., item format), (2) subject matter, or (3) classifica- 
tion in relation to a taxonomy (e.g., Bloom's taxonomy). 

In some programs, the answer line can be used not only for 
storing the specific answer to an item, but also for information 
that can be used to help find items* For example, the following 
might be stored in the answer line* 
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key words in an •■■ay, notes to oneself or any 
* alphanumeric information, or if the item* are based on a 
set of objectives, the abbreviated name or. number of the 
objective tested by the item. 

Another piece of "information that would be useful in retrieving 
appropriate items for a given instrument is an indication of item 
difficulty. This could be accomplished by simply placing in the 
answer line a rating of "easy," moderate," or "hard." A more 
sophisticated method would be the ability to include both 
difficulty and discrimination indexes for all item alternatives, 
Using a sort routine, items could then be selected on index 
values, as well as information on content, format, and other 
characteristics. 

This inclusion of specific information useful for item retrieval 
adds a whole new dimension to instrument-generation programs. 

Printing 

Once items are retrieved from the bank for a particular 
application, it is helpful if they can be edited to tailor them 
to that setting. It would also be useful to have the option of 
saving the edited items in a separate file for later use. In any 
case, the original set of items in the item bank itself should 
not be permanently altered by these last-minute modifications. 
This is especially important if the item bank is intended to be 
genericjfor example, if it is a set of essay items on current 
events where the details of the items are to be added in relation 
to the latest happenings. 

In addition to editing capabilities, a useful program will allow 
one to format an instrument to a particular situation. Using 
special headings or titles *■ one way to accomplish this. Being 
able to tailor the instructions can greatly improve the utility 
of an item bank, too. The capability to determine left and right 
margins, to determine the number of lines of print and total 
numbers of lines per page, to require a pause after each page is 
printed, and to print all or just part of a test are all program 
print features that can help improve the face validity of an 
instrument. 



Summary 

Programs exhibit these characteristics to varying degrees. 
Trying different programs is the only way to determine if the 
features you need are included and readily usable. 
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Instrument Generation Sampler 



Program/Company 

Author I 
Radio Shack 
Education Division 




System Comments 

TRS-80 Test assembly , on-line 
I/IZI testing, and the devel-' 

opment of student 
records/profiles are 
features of this program 



The Learning 
System, Microlab 
Highland Park, 
Illinois 



$150 



Apple 



On-line testing of items 
from a program item 
bank, class statistics 
and student profiles 
are all part of this 
program. 



Test Bank 2.1 

Advanced Technology $450 

Applications 

San Diego, CA 



Teacher Utilities $37 
Vol. 1 

Minnesota Educa- 
tional Computing 
Consortium 
(MECC) 



TRS-80 Flexible text entry, 
I/III item editing, -test ' 

preparation are just 
some of the features of 
this program . 

Apple II Item files, on-line 

testing, test assembly, 
test printing, plus 
* class statistics and 
grades are features of 
this program. 
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ELECTRONIC SPREADSHEETS 



Some say that the electronic spreadsheet in the form of 'the first 
VisiCalc program is what started "the microcomputer revolution, 
and particularly the Apple computer. With this very baaic tool, 
a microcomputer can be used to do anything that it is possible to 
do by hand using a multi-column ledger page. For example, 
spreadsheet programs can be used tot 

prepare a budge:, make an income tax projection, 
calculate cash flow, do ccst analyses, determine overhead 
allocations, generate, sensitivity analyses, calculate' 
weighted averages, prepare statistical suromar .es, analyze 
survey results, prepare btd specifications, keep track of 
study participants, and more. 

In a few short years spreadsheets have grown from not much more 
than electronic ledgers to programs that include present value 
function, linear programming, and calculus functions. • They also 
ara likely to be able to read d \ from files created by other 
programs, such as accounting api ..cations or data bases. 

Integrated programs are often build around a sophisticated 
spreadsheet. One form of integration is the program that 0 
includes spreadsheet, graphics, and word processing programs all 
in one super program. Examples of * this type of program are MBA 
(Context Management System; Torrance, CA) , and 1-2-3 (Lotus 
Development} Cambridge, MA) . Companies like VisiCorp provide 
compatibility among the different programs in their line, such as 
VisiCalc, VisiFile, and VisiPlot so that data can be shared among 
these separate programs. A new development is the integration of 
spreadsheet and data base management programs sftch as LogiCalc 
(Software Products Int'l; San Diego, CA) . In trying to decide 
among different approaches to integration, one must consider both 
the quality of the individual programs and the ease with which 
data can be transfered. 



Examples 

The examples on the next several pages illustrate what the 
VisiCalc program can do. 
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BEST COPY-. AVAILABLE 



WHAT CAN VI1ZCALC UO*? 



CALCULATIONS.^ ; " 

Lika a calculator, VisiCalc oxcolo at parforaing calulationa 
(adding* oubtractlng, aultl plying, dividing). In tha axaapla 
ooIom, aaooona antara tha nuaoor of atudonto participating in • 
Chaptar X prograa in tha ahadod araa. Tha VisiCalc workshoat 
total a tha nuaoor of atudanta at oach grada and in aach aubjact 



NUMSSA OF CHAPTSJt I STUDSNTS 

l\ hath Total 




OF ChAFTtH X STUDENTS 



Total 



I \ or Ada Road Hath Total 

2 23 14 37 

3 39 27 42 

4 23 23 42 



Total S3 44 147 



RECALCULATION 

Unlika a calculator, ViaiCalc can oaally racalculata tha roaults 
whan any valua ia changad. In tha aaaoplo balow, mm raduca tha 
FTt . for Ooniaon to try to raduca tho projact total ta a aora 
raaaonaolo figura. ViaiCalc iaoadiataly racalculatas tha totals 
uaing tha now valua for FT1. 



m valua 
PRCySCT 



S^aff FTI Salary Sonofit Total 

iJonaa 3470 

Ooniaon mm mfm 13270 

ttllliaaa' ■ M| Nil 3470 

Clark H MS 14400 

Faddia I ■ MSB 13270 



Total Salarioa and Sonofito 



53 

54 



PPJUtCT 9TAPF MJDfCT 



•taff 


m 


telary 


•enofit 


Total 


Jam 
Danlaon 

Willi AM 

Clark 
Paddlo 


m 9 

1.0 
1.0 


9490 
12729 
' 9490 
13900 
12729 


1990 
• 2949 
1990 
2790 
2949 


9*70 
7739 
9470 
14*90 

19270 










91023 
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TABLE LOOKUP 

04 tan mm have to look up valuoo In a tablo <e.g. toot ocore, 
Mlarlee, bonuo pointo* before doing a eoaputatlon. VioiCalc 
^an do the tablo lookup tor uo. In tho exaeple, mo enter a coda 
«nd tho Morkohoot look* up tho propor pointo and eooputoo the 

total. 



Activity 



pointo 



9tudent Toot hawk eodo Total 



iko road 1 
Participation 2 
■xtra roport 3 



10 
20 
40 



Janice? A> 




97 


Dvrtnis^B 




104 


o 




44 


o 







DATA 



In-foraatian can bo otorod on floppy dieke for later, uee 
e»aeple below, proarao expenditure* aro added to a 
teaplate oach oonth. Tho cooputor rocooputoo tho 
Expenditure* and Porcont of 9udgot Expended. 



Zn tha 
VioiCalc 
Yoar-To-Data 



PM39RAJ1 EXPENDITURES COMPARED TO 9UD9ST 



Act 

« Account 1 


budget 


YTO 
■upend 


X of 
9ud«ot 


100 salaria* 


94000 


14000 


29 


200 9onoflto 


14900 


3*29 


29 ' 


300 Pch aarv 


1200 


900 


47 


400 9upplloo 


1900 


2100 


117 


900 Outlay 




0 


0 


400 Other 




0 


0 



JAN 
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BEST COPY AVAiLkriLt 



BEST COPY AVAILAdli 



LOsXCAL OCCZSZONs 



Of tan wo want to do a computation only if mm condition is true. 
For oaaopla, ho Mill consider students olgiblo far a special 
prograe only if their toot scars or grade point is above or bolow 
soao criterion. Tha Morkohoot bolOM aorko a otudont aa olgibla 
far Chop tor Z service* only if tha tost aeoro is bolow tha 
cutoff. 

Chapter Z studont sol act ion Markshaot 



Cutoff on flooding 39 
toot: Hath 3? 



Hath 
KlgJble 



IZMPLK sttAPHiCS 



Do you ovor tiro of reading tables of nuobora? VlaiCale can holp 
by constructing sioplo bar grapha. Mora mo an tar nuobora in a 
graphing Morkoheet which roscalos and dioplayo tha rasulta. 



mzmmmt mjotxr nmoLumtrr by month 

Month enrol leant 



Oct 



Jan 
Fob 




Apr MB a iiieiin i 

May 



» 
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Advanced Spreadsheet Features 



Recent spreadsheet programs provide extended features that are 
not available with the original visiCalc. The table below 
suggests sons features to look for in the new generation of 
spreadsheet programs such as Multiplan, superCalc2, and Advanced 
VisiCalc. 



Allows worksheets to be linked together 
(e.g., Years summary worksheet accesses 
totals from 12 Months Summary worksheets) . 
Makes the spreadsheet seem three-dimensional. 

Allows the rows or columns to be sorted in 
numeric or alphabetic order (e.g., reorder 
list of students from lowest test score to 
highest for selection purposes) . 

Executes a series of commands from a command 
file that you have created (e.g., load a 
worksheet, print the results, change a 
value, print the new results) . 



Spreadsheet Program Sampler 

System Comments 

Apple II The first spreadsheet 

TRS-80 II, III program, very popular. 

Atari 

Commodore Pet 
IBM 



Feature Description 
Consolidation 

Sort 



Execute 



4 



Program 
Vis iCalc 



Advanced VisiCalc Apple III 

SuperCalc CP/M 

IBM 

Multiplan CP/M 

IBM 

magazine 



Includes a number of advanced 
features over VisiCalc. 

Similar to VisiCalc with 
some minor improvements 

Called software package of 
the year by Infoworld 



Note: CP/M stands for microcomputers using the CP/M operating 
system, (Control Program for Microcomputers) . Mont 
business-oriented microcomputers, such as TRS-^0 Model II, 
NorthStar Advantage, DEC Rainbow, Osborne I, and Xerox 820 
fall into this category. Also note that an Apple II with 
a ZBO softcard can use CP/M software. 
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STATISTICAL ANALYSIS 



At the heart of all evaluation and assessment efforts Is the 
analysis of data. Statistical analysis programs on main-frame 
computers have provided the main statistical source of support 
over the last 25 years. Accessibility to mainframe systems and 
their steadily increasing costs, together with the rapid advance 
of mini- and microcomputer technology, has begun to change that 
picture! Recently microcomputer based programs, ranging in price 
from $20»$2,000 have become available. Of course, taey vary 
greatly in their features. 

There are 5 sets of features that should be examined when 
considering the purchase of a microcomputer based statistics 
program. The first is documentation. This includes the written 
information about how to use the program and about the technical 
aspects of the program. The second feature is data management, 
including data entry and editing. The third feature concerns the 
statistical manipulation of data in terms of descriptive and 
inferential statistical procedures. A fourth feature is the; 
printing of information. Included here is the simple printing of 
raw data and the generation of complete reports. There is a 
fifth, general feature which might be termed special 
capabilities, such as the availability of a random sampler and 
the extent to which the program can be configured to a particular 
system. Each of these features is examined in more detail in ,the 
following discussion. 



Written Information 

The documentation for a program can be a major factor in 
facilitating or hampering its use. Good documentation for 
statistical software will at least provide some description of 
(1) the way the software is organized, (2) soae basic Information 
about each feature of the program, and (3) more detailed 
information about the statistical procedures and when different 
procedures might be selected. Welcome additions are a set of 
examples on a tutorial to show how to use each program feature 
and the results obtained, and examples showing what printed 
versions of the results will look like from a simple printing of 
cases to finished reports. 

Exemplary documentation will include the particular algorithm 
used in each analysis so that the user can be fully aware of its 
assumptions. The best documentation will also provide 
instructions for modifying formulas to better meet particular 
situations. 
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Data Management 



Data management starts with the entry of data into the program. 
Some programs provide the option of entering data either directly 
from the keyboard or from a data disk. 

A very elementary question to ask about a statistical program is 
what kind and how much data can it handle? For example , can one 
enter integer, alphanumeric and/or decimal data? And what is the 
total number of variables and the' number of cases that are 
possible? 

Two data entry procedures exist , case-by-case entry, where all 
variables for each case are entered at the same time, and 
variable-by-variable entry, where all cases for each variable are 
entered as a group. Better programs give you a choice between 
these two procedures. 

If it is possible to enter data from another disk, one must know 
if data from a data disk needs to be formatted in a way unique to 
the program, or if data formatted in a standard way, such as DIP 
files, are acceptable. If DIP files are acceptable, then data 
can be shared with such programs as VisiCalc and DB Master. It 
is also important to know if data are stored in sequential files 
or random access files, and if conversions are possible, because 
of the different ways these files are accessed. 

Once data are in the program, there should be procedures for 
maintaining them. At a basic level, maintenance includes adding 
new data, correcting erroneous data, and deleting unnecessary 
data. There are some programs which allow transformations by 
constants, exponentials, ranking, and so on. Being able to add 
new data can help to make a statistical program more like a data 
base management program, since the features can be used to build 
a record regarding a given case or a particular variable. 



Statistical Procedures 

Programs vary in the range of statistical procedures they include 
and in the variety of procedures regarding any one type. The 
following list is a sample of the range and variety of procedures 
that may be offered: 

Descriptive Statistics 

e Frequency 

e Mean 

e Median 

e Mode 

e Range 

e Standard deviation 
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Measures of Relationship 

Correlation (e.g., Pearson product-moment correlation 

co-efficient) 
Contingency tables/cross-tabs 
Linear regression 

Distributions used in statistical Inference 
Normal 
Chi 
P 
t 

Analysis of Variance (ANOVA) 



One Way (Pixed effects) 
equal N's 
unequal N's 

Two Way (Pixed effects) 
equal N's 
unequal N's 



0 



One way and multifactor analysis of variance 
randomized designs 
factorial designs 
split-plot (mixed) designs 



Not all programs contain all types of procedures, and some 
include different specific procedures within a type. Therefore, 
it is especially important to examine statistical packages in 
light of your specific needs and preferences before purchase. 



Printing 

There are times throughout the process of using a statistical 
program that printing may be desired. When data are being 
entered, for example, one may wish to get a printed case-by-case 
or variable-by- variable summary in order to verify the accuracy 
of the data. Printed results of computations, especially of 
intermediate processes such as a regression equation, which may 
be used in other computations, can be helpful. And, of course, 
the results of analysis should be printable in a format that is 
consistent with conventions (e.g., contingency table, ANOVA 
table) and should be clearly labeled so that one can easily 
interpret them. 

Beyond the printing of individual results, it is often useful to 
present a graphic picture in the form of scatter plot, histogram, 
and so on. These may then be combined with the results of , i 
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analysis to form a report. For example, a report, summarizing an 
item analysis might have 'Jie following information t 

i 

<••* * 

• item analysed 

• number of respondents 

number cheeked 
numbar selected 

• number selecting each response 

• percentage selected regarding this response 

• percentage answering this response 

• totals for each of the above 

• no answers 

• median value 
» average value 

• standard deviation 

• a histogram of responses 

When looking at report generation features, one should seek the 
kir.d of flexibility offered by the best data base management and 
survey development programs. That is, a program should allow 
control over (1) placing headings and footnotes on a page, 
(2) formatting the arrangement of textual and other information, 
and (3j storing completed reports for later use. 



Sampler of Statistical Analysis Programs 

The listing of computer statistical aids which appear at the end 
of this section summarize some of the current programs. It is 
vitally important to review first-hand any of the programs listed 
in this section. In fact, a good way to find a reliable vendor 
is to inquire about preview privileges and technical support. A 
30-day trial period to assess the quality of a program should be 
allowed before making a final decision. During that time 
frequent interaction with either the local dealer or developer 
will indicate the quality of support available. 

W\th this experience, you and your staff can gain confidence in 
the performance of a piece of software and in the technical 
support available as backup. 
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A U8TIMQ Of NXCMOONTORR 
STATISTICAL AIDS 

The liitin^i bilow have bnn adapted f torn The tot clew 
S tatistician . Feb. 1993, Vol. 37, Mo. 1, ». 13-44. 
Ink • "Mot Known".) 

Package Language 

Name * ' *nd 







r^Mnr infcicM 


Bvstem 


ADBCat 


MmI * ■Oil m W9 XX 


n*t* lAmn iiMilafcim 




■ .?M 




aJI 1 >lmi . tiBfiliiHB* 

■aiwing, iff 


CP At 






IWVfUf VI WW lf» , 


Xaii 




10120 


ohi-sq, histograms, 








plote, descriptive, 








teete, others 




A I OA 


Action-Re sroh, 


Sialograms, AMOVA 


Basic 


$235 


Northwest 


deecriptlve, biveri- 






11442 Matin* 


ete multivariate, 






View Dr. m 


teete oocreletiona, 






Seattle, MA 


regression, plots, 






9S144 


transformation, 








neigh ting 




A. STAT 


Rosen Grendon 


Trsnsfocmatiora, 


Baeio 


$125 


Aeeoo. 


deecriptlve, 


CP/M 


294 Peter Green 


frequencies, tables, 


Apple 




Hoed, Tolland, 


regreeelon 


FIT 




CM 04014 






Curve 


Interactive 


Beet fit, eoalee, 


m 


Fitter 


Microware, 


average, smooth, 


Apple 


"35 


Inc. 


interpolete, leaet 






PO bob 771 


equaree 






. 1. SK 








^^t-e College 








PA 14101 
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BEST 



Package 
Haas I 

ters.f 

DAISY 
$•0 



Vendor 
Rainbow 

Computing, Inc. 
19517 Buslmss 
Center Drive, 
Nor t bridge, 
GA 91324 



Description 

j 

Descriptive, regres- 
sions, transforms, 
teete, AMOVA, non- 
par ame trie, tine 
eeriee, modeling, 
plote 



Language 
and 

System 
MR 

Apple 



Dyna- 



Dynaooap, Inc. degression! 
1427 Monroe Ave 
meg-$119 Boohester, W * 
AMOVA 14411 
$119 



AMOVA 



ieeic 

Appls 
Atari 
TBS-10 



BdStat- 

Pao 

$20 



Math- 

Stst 

$750 



Micro- 

stat 

$325 



Univ. of 
Mich . , Sc h ool 
of Education 
Ann Arbor, MX 
44109 



Mathematics 

Policy Re- 
search, Inc* 
P.O.Bo* 2393 
Princeton, 
MJ 01540 

loosoft 

F0 Box 44402 

Indianapolis 

Indiana 

40244 



Baeic 

Appls 



Deecriptlve, freqe., 
Chi -Square, AMOVA 
Two-May AMOVA, non- 
parametric, regression 
oorreletion, Chron bach- 
Alpha 



Descriptive, cross- IBM-PC 
probability func- CF/M 
tions, oorreletion, 
AMOVA, regression, 
data management 



Data Management Basic 
transformation, dee- CP/M 
criptlve, tests, IBM 
AMOVA, plots, regree- 
elon, time series, 
nonperassetrlc, cross- 
tabs, distributions, 
chi ~equmre 
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■v. 



Package 






Language 


Nam * 






and 


Anrx.i 




n*anr ittfc ioM 




Soien- 


Interactive 


Draws l/t gra^toa, 


MB 


tit ie 


Miflrnwiif a * Tim. 
muiuwifi , Atwu * 


■V I|WU1I| 






■ft 171 

rv HM w 1 JL 


llllll Dill 




•23 


Dept. IK 








Stat* College, 








PA 14101 






speed 


3ft Corp 




inn/ 




In fear nfcfci Mil 1 




fflllU 


$200- 


229 Buber 


das or iptivas 


Apple 
■ ^ ■ — — 


$250 


Villaaa Blvd. 








~tfeaterville, 








08 43001 






Statis- 


Creative 


Data Management, 


Baaio 


tics 


Discount 


curva fitting* 


TBB-S0 


FftC 


0of tware 


orobab i li ty * oanar al 

^BrWm^mm mm A mm mm wMM S> ^VIVS" P« 


ABPla 


$100 


251 8. Robert- 

™ mm w ev a ivir*^aa w 


statistics 

V S*^B v • mm aaVB 






son. Ste 2154 








Bevarly Bills, 








CA 90211 






STAT PRO 


Nedsvorth 


Databasa aanageejent, 


Paaoal 


$1995 


Electronic 


Descriptive, corr** 


Appla 




Publ. Co* 


Regress., extensive 


IBM 




20 Park Plait 


•ulti-variate, 






Boa ton , MA 


graph ioa tie* Bar las* 






02114 


AMGVA 




8TATFAX 


Northwest 


Pila aanagaNent, 


Baaio 


$500 


Analytical 


probability, des- 


CP/M 




I no* 


or iptiva, ragraaaion, 


IBM 




PO Box 14430 


nonparaMtrio, 






Portland, OB 


dlatrlbutiona, taata, 






97214 


chi-squared, ANOVA 





plou, randoa nusbars 



Research on Evaluation Prograsj 

Uorthweat Regional Educational Laboratory 



ERLC 



Package 
Hum A 

AB£JLl 

zurio- 

8TAT 

2*2 

1150 



Vendo£ 

Ideal Systei 
P.O.Box Ml 
PalrfJeld, 

ZA 522550 



Description 

Descriptive, oroes- 
taba, totals, Mann- 
Mhitney t r Wilcoxcx , 
1-2 -way ANOVA, 2 
variable acatterplot, 
Pearson correlations, 
tiaple linear ragraa- 
aion* i;ata filu 
wnagapent 



Language 
and 

Byjtsj 



Appla 



THB STATISTICS 88 BIBB 

Human BysteM Dynaaics 
9249 Beaeda Blvd., Suite 107 
Borthtidge, CA 91324 



ANOVA XX 
$150 



BSD 

MBQBBB8 
9100 

STATS 

PLUS 
$200 



ANOVA, ANOOVA* Many 
designs, 1 to 5 
factors, B to 12 
levels. All inter- 
actiona, marginals, 
means, calls, plota 



25 vara,, 300 ceres, 
predicted, reaiduala, 
plota 

General Statistics 
package, databaaa 
BanacsBsnt, nonpars - 
metrics, freqa., 
corr., t- teats, 
regressions 



ApplB 
IBM 



Appl* 
ISM 

m 

Appla 
ISM 
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GRAPHIC TOOLS 



Pages and pages of reports.. Who will read them? ' How can you sparteine 
reader's interest? Some authors would argue that graphs and charts are 
the most effective way to communicate an idea. Host people hate tables 
of numbers and refuse to read more than a page, or two of text. Rather, 
most people are visually oriented and can glean the basic message from 
a properly constructed graph. 

Typically, we do not use graphics in our reports because we cannot 
afford a ctraphic artist and lack the necessary skills ourselves. 
However, ae versatile microcomputer does have graphics capabilities. 



Software 



There are two basic types of software aids to graphing. Business 
graphics packages are designed to produce bar graphs, line graphs, and 
pie charts. The user enters the data values to be plotted and then 
selects the type of graph desired from a menu. The program 
automatically creates the graph on the screen a id allows the user to 
change or dress it up before printing. 

The second type, design or presentation graphics software, is more 
analogous to an artist's pellet and canvas. You draw lines, shapes, 
and colors on the screen and then edit them (shrink, expand, move). 
This type of graphics is not well suited for bar graphs, but its 
flexibility is perfect for diagrams* flowcharts, forms, and simple 
illustrations v 

The choice of software will be greatly limited by the 'computers and 
printers each package supports. Other considerations include such 
features as options for inputting data, variety of graph types, and 
flexibility in editing the graph before printing. 

Hardware 

Will my Brand x microcomputer handle graphics? Perhaps. Obviously, 
the computer should be able to display graphics qn the monitor screen, 
either in black and^hite, or color. While taken for granted with home 
computers designed for video games, this capability has been left out 
of most business microcomputers until recently. The resolution (or 
clarity) of graphics displays varies widely. 

Actually, the ceal problem is getting the graph on paper, until the 
last two years, most printers could handle only the simplest of 
graphics, and other, printers were too expensive. Today there are a 
number of low^cost devices that can print graphics, though the visual . 
quality stili""falls aWt^of what a graphics artist could do. 

The following examples^ilSustrate three options for creating graphics. 
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Character graphics. Standard characters like » f /$ and X 
ars used to create a graph tha ; can be output by any 
printer* Tha li sited char actars avai labia usually rasult in 
poor visual quality. Figure 1 shows results that were, 
plotted using character graphics. Thm connecting lines **re 
drawn by hand. 



Figure 1. School achievement profile using 
character graphics. 
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Dot graphics. A dot eatrix printer with a graphics option 
can producs graphs like Figure 2. Tha print haad of a dot 
eatrix printer consists of a row of pins which strike a 
ribbon to fere typewriter characters. With the 
software, the pins can be aade to f ire ' in any 
i to duplicate the shapes on the eoeputer screen. 
The Prise by Integral Data Systeee even has a eul ti colored 
ribbon to add color. 



hi 

2 



Figure 2. Bar graph of achieveeent gaini 
using dot graphics. ■ 
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Plot tat graphics. A 
b» un to gsnsrats 
graph ia drawn by 
that functions such 
cost plottsrs includ 
Xnstrussnts Hi plot 
At S800-2000, th 
sines a printsr Mill 



. spsclalizsd dsvics call ad a plottsr can 
good quality graphs liks Figurs 3. Ths 
a colorsd psn hsld by a oschanical ars 
liks ths husan ars. Exasplss a* ios- 
ths Hs«lstt-Pac».ard 7470A, ths Houston 
-29, and ths Strobs Graphics Plottsr. 
plottsrs ars still rathsr sxpsnaivs 
»till bs nssdsd -for standard tsxt. 



Figurs 3. Exaspls oi «7.ettar graphics quality, 
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Sampler of Business Graphics Software 



Package 


Computer 


Comments • 


APPLEPLOT 


Apple 11 


Easy to use but fc >er features than some 


PFS: GRAPH 


Apple II 


Works with PFS: FILE 

• 


VlSIPLGT 


Apple II 


Beat suited to time-oriented data 


Lotus 1-2-3 


IBM 


Combines graphics capability with spreadsheet 
and file management' 


GRAFTAL K 


CP/M 


Supports a variety of printers and plotters, 
and terminals 
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COMMUNICATION TOOLS 

Most people recognize that computers can communicate with other 
computers, but few people understand why this is important. Assume 
that you have test scores of a thousand students on a lar&s_computer 
and want to be able to analyse then on a small computer without 
re-entering the datay the computers must be able to exchange 
information even though the large computer may be miles away. 

Currently the major applications of computer communications in 
evaluation are: 

e Data communications - transferring data from large 
computers to small ones, transferring word processing 
documents between machines, transferring programs from 
one microcomputer to another. 

• Remote data processing - use microcomputer as a terminal 
to control the analysis of data on large mainframe 
computers, using statistical software like SPSS. 

e Online data base searching - access information utilities 
such as the Source, Dialog, and BRS to conduct 
bibliographic data bases maintained by those utilities. 
Two educational data bases are ERIC and RICE. 

e Electronic message systems - Electronic mail systems, 
computer conferences, and electronic bulletin boards are 
examples of systems that allow other computers to, call in 
and leave or receive messages. 

There are several ways that communication may occur between computers, 
but we will focus on the most common form, telecommunications. 
Briefly, here is how it works. The computer is connected to a device 
called a modem which converts the electronic signal coming from the 
computer so that it may be sent over standard telephone lines. The 
moc.em at the other end translates the signal back to its original form 
and reiays it to the computer. Thus, what you type at the keyboard is 
passed over the telephone 1 ,ne to the other computer and vice versa. 

Sof twar e 

Tho software tool used most frequently for telecommunications is known 

a "terminal" program since the program essentially turns the 
microcomputer into a terminal (keyboard and display) hooked to a large 
computer. The main function of the program is to send characters typed 
at the keyboard out the cable to the modem and to interpret characters 
coming back from the modem. 
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A Sampler off Terminal Programs 



Program Computer 
ASCII Express Apple II 

Crosstalk CP/M, IBM 



LYNC 



Omniterm 
ST-80 



CP/M 



TRS-80, IBM 
TRS-80 



Comment s 

\ 

Many fine features. 

Available for a variety of 
computers; many features, such as 
protocol file transfers. 

Unique license is for the 
institution, not just for a single 
computer. Available for a variety 
of computers. 



Many features, such as error 
detection 



VisiTerm 



Apple II 



Hardware 

The main piece of hardware required for communications is the 
modem, the device which sends signals over the telephone line and 
translates the incoming messages. The other piece of hardware 
needed is a serial port. The computer must have a way of 
transferring information out to the modem. This interface or 
port is usually known as an RS232 serial port. Most printers, in 
contrast, require a parallel port. Most business computers are 
sold with both ports, but others, such as the Apple II, need an 
additional circuit board. 
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Company/Product 
(Price) 

Ha yea/ 

Smartmodem 300 
(#289) 



MP J/ 

MFJ-1232 
($12935) 



Novation/ 

D-CAI 
($199) 



A Saroplar of Modems* 



Co mputer 



RS232C 
Interface 



RS232C 
Interface; 

TTL/CMOS 
inputs/outputs 



RS232 
Interface 



Comments 



This auto-dialing, direct- 
connect modem is full duplex, 
with a variable baud rate of 
110-300. Audio monitoring 
and self-testing are also 
features 

This acoustic coupler, full 
or half duplex modem has 
both 110 and 300 baud trans- 
mission rates, it may be 
connected to the Apple II 
game port, with MFJ-1231 
software. 

This direct connect, auto- 
dialing modem is both full 
or half duplex with a 300 
baud transmittion rate. It 
has a self-testing feature. 



* prom The, L. Data communications: A buyer's guide to modems 
aud software. Personal Computing , March 1983, 102-103; 
108-109. 



Alternatives to Telecommunications 



There are alternatives to the telephone for transferring 
information between computers. Local Area Networks link 
computers that are close in proximity so that they can share such 
information and peripherals as printers and hard disk drives. 
When the information transfer does not have to occur immediately, 
data can be moved using floppy disks as there are now programs 
which convert the fornr . of a *"»oppy disk from one computer to 
the fo-ntat of another. 



\ 



The, 



R eferences 

L. Data communications: A buyer's guide to modems and 
software. Personal Computing , March 1983, 96-103; 108-111; 
114-117; 122-124; 127-128; 171; 173. 



ERIC 



72 



73 



NETWORKING 



A local area network is a coordinated system for communicating 
data, it is a system that lets computers, printers, disk drives, 
modems, and monitors interact with each other. A basic local 
area network (IAN) includes five components: 

e the hardware, made up of computers and peripherals 

e the network interface, typically an expansion card 
which plugs into the hardware 

e the network master controller, either a chip on the 
expansion card, a hard disk drive, or a dedicated 
computer 

• the network server, a hard disk drive that carries 
both the software for the IAN specifically and the 
programs available to network users 

e the wiring to connect the par"ts of the network 

The personal computer lo^al networks most often used are made by 
CorvuB systems, Inc. and Nestar Systems, Inc. Over 5,000 Corvus 
Constellation and Omninet networks, and nearly 1,000 Nestar 
Cluster /One and Plan— 4,000 networks are currently in operation. 
These and some of the other more popular networks are described 
in the sampler of networks. 

Two developments have helped to spread the use of local area 
networks. One is the change in the type of wiring which link 
together the components of a system. New cables (coaxial 
baseband wiring) have cut the cost of this important part of a 
network by two-thirds. They also transmit information far more 
quickly and may eventually be used to carry data, voice, and 
video message" simultaneously. 

Another improvement is che way the network actually functions. 
The earliest systems used a star pattern, where the master 
controller. (typically a hard disk drive) was located In the 
middle of "slave" terminals. The network distributed data from 
the center of the star along its arms to the terminal at each 
point. Communications were slow because ev ything had to be 
cleared and approved by the hard disk "drive before it could 
proceed. But now a bus configuration is used where all of the 
hardware on the network issues instructions independently and the 
master controller simply directs the data traffic up and down the 
length of wiring. 
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As was noted In tht art ids, Networking the Workplace, from which 
the information for this sac t ion was drawn i . 



•Tha beauty of networking personal qowputers as 
compared with using Minicomputer* or Mint rases is that 
with the aini or mainframe, each tiae you add a user to 
the ayatem— each tiae you install a new dumb terminal— 
you detract from tha overall computing power of the 
systea. You simply slow the systea down, 1 aayv Jia 
Fritchett, president of Trinity Computing Systems in 
Houston, Texas, which sails LMfs to large installations. 
•With -the personal computer r though, *it is just the 
converse* You add power to your systea each tiae you 
enhance the network. You are giving it aore aeaory or 
providing another peripheral or adding aore storage 
capacity. 1 (Rdthfeder, 1983) 



iMpltr of artworks* 



Iroqra^CoaoanytOoat) Coaputera 



DMcriitijn 



Xntarfao* jard, 
$495 1 artwork flla 
aerwar (with lMcb 
drive), $4,315 
Corvua fyataa, Inc. 
2029 O'foola Hvenui 
fan Jom, OA 95131 
(401) 945-7700 



Ootwa joooapt 
Applt Xi. 

mi - k 

oac uai-ii 

TX frofaaaional 



(tei^t links up to $4 workstations 
~»ar * auiaua distaaos of 4000 faat 
M«ing twiatad-pal* wl?lnf . ft* 
fejaputsr sad paripharal tutor faos 
wisrds oootain a tranaportar or nat- 
work aaatar oontroller chip. Tha 
aoftwaxe aarvar is attached to a 
hard diak driva. Disearata eoaputari 
on tha natwork ooaaunloata with aaeh 
other* 



PIAM 4000 Appla XX, XXX 

Xnterf ica card, ITM - PC 

$595 1 

network f ila 

aarvax (with 50 ML 
< tiva), $22,70^ 
aaatar syataaa, Inc. 
2*5* t. Bayshora Id. 
Palo Alto, CA 94303 
(415) 423-2223 



»lan 4000 linka up to €4 workstation* 
workstation ovar a diataaoa of up to 
four ailaa uaiag baaaba n d ooaxial 
eahla. Tha e**putar and peripharal 
lntarfaoa oarda oootain an intelli- 
gent chip—callad taaouroa In tar fact 
Modula (AIM) ~to aarwa aa tha natwork 
aaatar controls r. Tha natwork fila 
aarvar la attaohad to a hard diak 
drive* 



* la sad on Rothfadar, J. networking tha work pi act. 
^ araonal Computing. Juna 1903, , 15. 
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Znterfaee card, 
$*9it Betwbrk file 
Mint (with iO-MB 
drive), 110,000 
oatapoiat Con. 
•725 Oatapoiat Dr. 
.tea Antonio, TX 
712*4 

(512) ftt-700 



Ontnpoiat 
(TM40, nodal 
14 and Mode XX 
by and of 1502) 



AbCaet link* up to 255 ooaputers over 
a distance of up to four nilaa using 
baseband ooulal eablaa. Tbe inter- 
faea card con tains tbe aaaa intelli- 
gent oblp—tbo UN— aa tbe ont uaad 
in Beater* a mm 4000. Tbe network 

fH5 i*?*** *■ ««tenbed to a bard 
4tek drive. Tandy Oarporatloa baa 
M^onnoad knot Ik plana to bare lta 
ladlo flunk nodal 15 and Nodal XX 
oonpotera support AKnot by tba and 
•f tbe year. 



Zatarfaoa card, 
#50 1 Betwork fll« 
•enrar (with 10-MB 
arlve), 011,500 
Xom Corp. 
1350 Bborablrd nay 
MouefiAla View, ca 
§4042 

(415) til-tf02 



XBM - K 
Apple (by lata 
••3) 



BtberObare and till etbar 2Con pro- 
dueta operate on tba Btbernet' net- 
— r». An intelligent chip la oon- 
tc tba interface card to 
tba network. Tbe file aarver, 
it a bard disk drive la not ebocen, 
ana alao ba a dedicated ooaputer. • 



faros Corp. 
0414 Wrenebwood id. 
Dallas, TX 75252 
(214) 405-4045 



Btbaraat la aa aktonpt to create a 
enlveraal networking standard for 
oonputara. It la a ooulal baseband 
boa network that will book, up 1024 
workstations over a diatanoa of 2.4 
k iln — ta rs, its arebitoetara and 
♦f jo l og y i« not propriatary so 
aaparato dlatrlbatora r~il 
Jtbarnet-oaopatlble products. 



Zatarfaoa card, 
•500} network 
fila aerver, (to 
be announced) 
Apple Corp. 
20525 Marianl Ave. 
Cupertino, CA 
55014 

(400) 554-101Q 



Apple Canputara 



Apple net la joat reaching narket. 
Xt can aooosBodate workstations over 
a dlatanee of 5000 feet in a bus 
configuration. 
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PLANNING FOR MICROCOMPUTER USE 



People often find it is difficult to decide whether or not to buy 
a computer or what computer to buy without knowing what 
"capabilities" computers have. It should be clear from this 
worktaop that a computer is a very sophisticated, generic tool . 
that can be supplied with multiple capabilities including: word 
processing, data base management, calculation and statistical 
analysis, graphics, and communication. The only restriction is 
thet the program having the instructions for these capabilities 
must be compatible with a given sy'stym in terms of the system's 
central processing unit, random access memory size, disk 
operating system and auxiliary storage features, and so on. 
Therefore, in making decisions about computers, one should start 
with an analysis of capabilities in relation to classes of 
software. 

t 

A three-step process can be used to guide one from the 
consideration of capabilities to the selection of a microcomputer 
system* 



Step 1: Know Your Needs 

The best place to bc^in is with an analysis of the tasks you do 
that could be accomplished using a particular microcomputer bayed 
program. These may be listed on a form such as that shown on the 
following pages, "Tanks/Software Matrix." Obviously, many tasks 
, could be accomplished with the aid of a microcomputer; the 
question is, which on»s should be transferred to a computer 
system? The following are some criteria to use in describing 
which tasks should be transferred: 

1. Identify and eliminate tasks that are already being 
efficiently accomplished 

2. Rate the remaining tasks in terms of 

a. potential for time/cost savings 

b. relative importance 

Rating the tasks can be based on the general capabilities of 
software. For example, if much production typing is done, and 
any one document goes through many drafts, a word processing 
program would save the time and money associated with repeated 
typings. 
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Step 2 1 Identify The But Software 

One* tho top priority tasks are identified, the mos,t appropriate 
software must be selected. This is where the evaluations 
presented in the various buyer 'vguides listed in each reference 
section of the workshop materials cons in handy. These guides 
typically present extensive lists of program with sons 
( identification of their features. The features are the ones 
described in the narrative sections of the workshop materials. 
For example, a buyer's guide to data base systems, might include: 
number of records per file, number of fields per record, maximum 
field size, whether the files are fixed or variable, format of 
files, index scheme, special features, hardware requirements. 

Evaluating software beyond the features listed in buyer's guides 
^ cari be very confusing. The criteria listed in the following 
section, "Criteria for Review of Professional Software," are 
intended to facilitate reviewing professional software. They are 
grouped under the following topics: description of the package, 
documentation, inputs/operation, outputs, and general 
characteristics. The only way to assess software in regard to, 
these criteria is to try it out. 



Step 3: Identify Appropriate Hardware 

As noted above, many software buyer's guides include hardware 
requirements/ The form "Hardware Specif ications Worksheet" on 
the following pages lists various hardware specifications. A 
separate sheet can be generated for each software package. 
Hardware selection can then be made based on the number of 
preferred packages that will run on a particular system. A 
formal way to make such a decision is shown in the "Hardware 
Evaluation Worksheet" shown at the end of this section. In 
making a final choice regarding a system, it is important to be 
aware of the families of microcomputers and the machine i" 
belonging to each family. 

m 

Compatibility among machines in a given family can broaden the 
range of possible choices. There are various types of 
compatibility. These include: .. 

e complete software compatibility 

e video compatible 

e disk compatible 

• operating system compatible 

e compatible central processor chip 

A demonstration of a particular software package on a particular 
system is the only sure way of proving compatibility. ' 
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Two Sides of the Coin: 

* 

Microcomputers as tools for Conducting 
Evaluation Research ard as the Focus of 
Evaluation Research 



Presented by 

Peter J. Gray, Ph.D. 
Research Associate 



Research on Evaluation Program 

Northwest Regional Educational Laboratory 
300 S.W. Sixth Avenue • Portland, Oregon 97204 



JUNE 1984 
NWREL 



o 

MICROCOMPUTERS AS TOOLS FOR 



rONnilOTING EVALUATION RESEARCH 



POTENTIAL BENEFI TS 

• Appropriate microcomputer software 

* 

for evaluation research tasks 

POTENTIAL PROBLEMS 

•People, organizational, and 
technological fgctors to consider 
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EVALUATING THE USE OF MICROCOMPUTERS 
IN EDUC ATIONAL SETTINGS 

1 

ASSESSING CURRENT CONDITIONS 

• Instructional, administrative, and 
support services uses 

DEFINING DESIRED USES 

• Policy analysis as an evaluation 
research method 

EVALUATING IMPACT 

f 

• Efficiency, equity, and quality issues 

PJG/ROEP 
JUNE 1984 
NWREL 
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TOOLS FOR CONDUCTING EVALUATION 

RESEARCH TASKS 





1 TOOLS* 




Word 
Processing 


Data Baje 
Management 


Calculation & 
Statistics 


Graphics 


Communication 


TASKS: 


ProDosnls tt 

Planning 


* 

• * 


Management 


Data Collection, 
Analyc and 

Interpretation 


| Reporting 
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WORD PROCESSING 
Text Entry Plus 

• Formatting 

• Editing 

• Merging 

• Printing 

Advanced Features 

• Hard disk compatability 

• Macro-commands 

• P-eview printing 

• creates standard files 

• Split screens or windows 

• Print selected parts of fil 

• Mouse compatability 

PJG/ROEP 
JJNE 1984 
NWREL 



DATA BASE MANAGEMENT 

• FILE CREATION AND MAINTENANCE 

• FILE STORAGE AND MANIPULATION 

• RECORD RETRIEVAL 

• PRINTING 



PJG/ROEP 
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CALCULATION AND STATISTICS 



SPREADSHEETS • 

• Calculate and recalculate 

• Table look-up 

• Logical decisions 

• Printing 
STATISTICAL ANALYSIS 

• Descriptive stat 

• Nonparametic stat 

• Linear models 

• Time series 
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GRAPHICS TYPES 

• Business/presentation 

• Design 

PRINTING TYPES 

• Character 

• Dot matrix 

• Plotter (color, 3-D) 



COMMUNICATION 

c 

TELECOMMUNICATIONS 

• Data communication 

• Remote data processing 

• On line data bank searching 

• Electronic message systems 

LOCAL AREA NETWORKS (LANs) 

• Similar machines/programs 

• Different machines/programs 
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PEOPLE, ORGANIZATIONAL, AND 

TECHNOLOGICAL FACTORS 

PEOPLE; 

• Attitudes 

• Knowledge 

• Skills 

• Interpersonal relationships 



/ 



ORGANIZATIONAL: \ 

• Goals 

• Structure 

• Funding 

• Planning and development 

• Implementation and evaluation 
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TECHNOLOGICAL: 

• Software/hardware: 

Selection, Maintenance, Service, Support 

• Facilities: 

Space, Funiture, Lighting, 
Power, Security 
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ASSESSING CURRENT CONDITIONS 



\ ( 



FACTORS 



USES 



Technological 



Organizational 



People 



In structional 

CAI 

Problem Solving 

Computer 
.Literocy /science 



Administration 
and 

Support Services 



Local! 

District-wide 



i 



I 



i ^ 
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DEFINING DESIRED USES 

POLICY ANALYSIS CAN 

HE LP WITH: • ,' 

• Clarification 

• Question development 

• Data collection, analysis 

I 
i 

grid interpretation 

• Adoption pf alternatives and 
their implications 
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EVALUATING IMPACT 



• EFFICIENCY 

• EQUITY 

• QUALITY 
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Presenter's Guide 
Cost Analysis Workshop 



The workshop follows the outline order exactly. First look at the 
outline and read the "Cost Analysis Workshop" article. These two 
resources describe the workshop. 

Next look at the transparency set. They follow the order of the 
outline. Important points and transitions are noted in italicized 
♦ comments.* 

•> 

• The "Cost Analysis Workshop" article lists the materials to be handed out 
to participants. All materials are included in this set of materials. 
See also the background materials file for additional materials. 



\ 



o 



♦Following the transparency used for the workshop is the same transparency 
shown with notes and comments. 
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COST ANALYSIS WORKSHOP 



Introduction 

What is cost analysis? 
Why do a cost study? 



Terminology s . g vMU8 cogt effectiveness analysis ... 
Descriptive versus comparative cost analysis studies 

What is Cost Analysis? 
Cost feasibility 
Cost utility 
. Cost benefit 
Cost effectiveness 



* * 



When 
What 



How to select a method t ton-? 

Consider the decision problem; are there alternatives? 
Is the relationship of cost to outcome important to. 

the decision maker? 
what outcome data are attainable? . 
Ate effectiveness measures most relevant to the decision 

maker? 

# 

How to conduct a cost analysis 

Identify ingredients <• • 

What ingredients should be included? 

should different ingredients be included? 
is learned by listing ingredients? 
identifies components of the program 
points to reliability of the funding sources 
Why budgets are not used as lists of ingredients 

Cost out the ingredients 
pricing 

market 
shadow 
adjustments 

if ingredients are shared (]oint) 
if ingredients last longer than 1 

(annualized values) 
if program lasts more than 1 year 
distribution of costii 



year 

(present values) 
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Putting costs and outcomes together 

0 TransDortation study Example (see handout) 

Computer training example in "Cost analysis for educational 
'Tiinistrators" paper 

Factors to consider when deciding whether to do a cost study 

Pragmatic • ... 

are alternatives being considered 

time - 
cost 

availability of cost data 
availability of outcome data 
expertise of the staff 
availability of expert resource 

P ° lit: is a the decision maker interested in the results? 

What factors besides cost and outcome might influence 

the decision makers? 
What are the advantages and- .disadvantages of cost 

analysis information? 

e 

Exercises and discussion (20 minutes) t 

Summary 

•Streamlining* 

i ingredients^ additiona i ingredients if program is an 

adjunct to an existing program 
list only the largest ingredients 7 
use 4ngredients list of a similar program 
set up budget so that future studies can use the 
budget to list ingredients 
Costing out 

' use market prices as estimates - 
looK at one year of program only so to avoid 
having to adjust the prices 
' • do not cost out "free" ingredients such 
as volunteers 
use cost estimates figured by a similar program. 

Outcomes 

ignor^ effects (feasibility) 
estimate effects (utility) 
use already collected data (last years) 
* use another program's data 

Wrap-up , 

S!sc e us»%es?"!;8 d8 t h at could be answered in own district 
using these methods 
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From Research on evaluation Newsletter Vol 6, 

Research on Evaluation Program 

Northwest Regional Educational Laboratory 

300 S.W. Sixth Avenue 

Portland Oregon 97204 



Cc^t Analysis Workshop 



A workshop on oost analysis for school adminis- 
trators has bnn developed which provide)! an 
Introduction to four coat snslysls Methods. This 
workshop teaches skills naadsd for sslectinej the 
soit appropriate cost analysis Method to uss In the 
svsl nation of an sduostlonsl program. Developed by 
, Jsns Ksy Smith, this oost snslysls workshop has been 
conducted In sduostlonsl sgsnolss In Arison*, <t 
Csllfornlst snd Colorado. 

Bach workshop participant receives s packet of 
Mtsrlsls which Includes an outline of the workshop* 
s glossary of oost snslysls teraj, definitions of 
the four cost snslysls Methods, s sat of sserclss, 
snd s recently published paper by Jen* Kay Smith snd 
Nick L. Ssiith (1M4) sntitlsd •Convsrestional Coat 
Analysis for Sduostlonsl Adminiatrstors." This 
papsr dsacrlbes the four Methods in dstsll and 
provldss s listing of ussful references. 



l# *pri£ 1984, p. 2-4 
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BEST COPY 



VIM throe-hour workohop baql.ie with ■ dlecueelon of 
the rationale for conduct I nq coat analyala otudloo. 
It la pointed out that traditional econcalete Mpe 
lootadonly at coata, while tradlt^pnel edueetlonel 
raaaarchara have lognd only at proqraa 
At tha praaant tine, qivan fundlnq cata and tha 
teeultlna inoraaaa In veetione about tha relation- 
ship ol prog raw coata to proqrea outooMa, declelon- 
focuatd evoluatore have bequn to look at toth 
proaraa eoata and proaraa outcooaa. 

Tha participant a asa than Introduced to potential 
application, of coat analyala aethode, baqlnnlnq 
with a aleoueelon of elfht otMMon ^piaatlona that can 
bo onowared by thaaa aathodo. Thaaa ara *eetlone 
of tan aakad by adnlnlatratora, proqraa ooordlnatora, 
'•rograa participant a, and oven oaobara of tha 
co-unity, for eaenple, ooanunlty aeabere nay eek, 
"Mhat ara ve qettlnq for our tan ooney?" ^'*» h0 P 
partlelpanta ara ancoureqed to qenerate additional 
coat-ralatad quootlono that thay hava encountered In 
khalr own evaluation emparlance. „ 

Onca tha porpooe ot coat analyala aathodo I" 
adueatlonal evaluation la aede elaar, four eat hod a, 
coat taaalblllty, coat utility, coat benefit, and 
coat ofroctlvonooo ara defined In every day terne. 
Por aaaapla, tha partlelpanta ara ancouraaad to 
lneqlne theneelvee on a car lot looklnq at now 
pickup truofca. Thay ara qlven tha aeenarlo that 
thay hava aavad $«000 to buy a naw truok rand don t 
wan t to uaa credit). Thay aaa Truck A for $5500 and 
Truck ■ for $7500. Which purchaaa la faaalbla 
within thalr financial eonatralnta and which la 
not? Obviouely, It la faaalbla to purchaaa 
Truok ft. Thla la an aaaapla of coat faaalblllty 
roooonlnq, 

auppoaa, ho-avar, tha partlelpanta wantad to qo 
btyond faaalblllty and try to qat the noat for thalr 
aonay? if thay ware In facalnq and wantad tha truck 
to haul hay. thay al9ht look at the power of the 

\ 



trucke. in thle o.ea. Truck ft will haul up to 3 
tone of hey, while fruoe • will haul up to » ton. of 
hay, ty coeperlra tha coat of tha troche to thalr 
hauling eftectlveneee, you cen pee that It will coat 
11,133 (5500/31 to haul a ton of My with Truck ft, 
cohered to only M33 17300/51 to haul e ton of hey 
with Truck p. Cleerly, Truck » le tha noat coat 
effective aa lection. 

owe tha difference between the four coat anelyele 
ncthode le urleretood, eaatplee of their eppllca- 
tlona for educetlonal eveluetlon ere deeerlbed. ft 
flow chart la uead to dellneete the etepe of aethod. 
eelectlon. 

Tha workohop then bacopea nore epaclfle and looke In 
detell et tha atep eoanon to all coet enelyele 
aethodei ooeeooloq tha coata of e prograo. Por 
aeaaaalnq tha coata of a proaraa, tha lnqredlepte 
approach propoaed by ienry tevln (1503) le 
raooon.nded7»ertlclponte are alien the opportunity 
to concrete e conprahe naive Hat of ell lnqredlente 
(factor a) neceeeary to run a hypbthatlcel •* ond 
qr.de raadinq proqraa. Thla Hat auet Include all 
inqradlente of e proqraa. lneudlng "free- l"*"? 1 " 
anta euch ee volunteer, end equlp-tnt. The coet or 
equlpaent uaed auet ba calculated avan If It la juet 
borrowed froa another proqraa for a few houre e week 
(e.q., e eoaputer) . a 

Following qenorotlon of thle Hot of lnqredlenter en 
explanation le qlven ee to why the uaa of ■ 
for eetlaatlnq tha coot of a proqraa la Inefficient, 
ror exeapla, e budqet doae not Include free 
reeourcee. pay not Include lnqredlente thet h».*e 
already been peld for (ouch aa tha bulldlnql, end 
•ay onlt lnqredlente that are shared ecroee prograae. 
The budqet, becauaa It calta ^eee lnqredlente, ^y 
moult In a dletorted picture of what It *° 
run a proqran. Such e budget could not ba uaed by 
•dalnfetratoro of enothar echool to eatlneta what It 
would take for than to adopt tha proqran. 



BEST COPY AVAILABLE 



Once the concept of ingrediente ia cltir, techniquea 
of determining the coete of auoh ingrediente are 
touched ufron. Kara we look at uve of market and ° 

- jhadow pricea, and price adjuatmenta th#t nay be 
naadad if the prog ram laata several yeere or if tha 
ingredient j*, a longer Ufa than tha program 

Hteelf. ftrcauee thaaa adjuatmenta ara qulta 
tachnlealt participant a ara introduced to tha 
concapta in a general* rathar than a detailed, 



following that, actual applloetione-of tha four coat 
analyala mettode in educational a valuation ara ? 
dlecuaeed. Alao at thia time, additional factora 
which aey affact tna conduct of a coat analyaia ara 
diecuaaed. fro* tha ftaaaarch on Iviluation Fro- 
grem'a ongoing aerlee of atodlafc, on impedimenta to 
tha conduct of coat analyaia in education* a aat of 
pragmatic factora, auch aa tha availability of data* 
and tha time ami tha coat of conducting atudiee, 
have faaan idantif iad which affact tha conduct off a 
coat analyaia atudy. Xn addition, political 
factora, auch aa tha !ecieion maker 1 a aupport for 
tha atudy, hava baan etown to influanca tha conduct 
of tha atudy and tha uac of atudy reeulte. 

Conaidaration of thaaa factora it important whan 
deciding what ha r to conduct a atudy and whin aal act- 
ing tha peat appropriate method for tha analyaia. 
Following thia diecuaeion, participant! ara givan a 
aat of extrclaea which contain a pradtictl six of 
pragmatic and political conatrainta and ara aakad to 
aalact tha aoat approprlata coat analyaia aathod for 
tha evaluation. 

Tha workahop conclude* with a diacuaaion of met hod a 
of •etreamllMng" tha atapa of (1) Hating ingredi- 
ante, (2| valuing ingrediente, and (3) meaeuring . 
outcomee. for aaoh atep, a minimum of four stream- 
lining teunnlquoe ara of farad* for example,- in km 
caeee, only tha largaat ingrediente night ba Hated, 
or already collected meaeurea of outcoiaaa My ba 



uaed. Tha* affact of^mch meitmUnlng ^n 
tha reliability and validity on tSe atud- 
eited and partioipanta ara encouraged fcc r 
adopting any of tha atraaaillning techm M*» *y 
with caution. * ■ 

Development of tha workahop waa funded by tha 
Region 4 Chapter 1 Technical ftaaiatance Center and 
tha ftaaaarch on Evaluation Frog ran. Pot more infor- 
nation about tha coat analyaia workshop, contact Or. 
Jana Kay Smith, MtffilL, 300 s.tf. Sixth Aw;ue, 
Portland, OA S2704. 

fteferences 

Levin, H. M« (1913). Coat-tf fact i vena eat A 
Primer . Beverly Hi lie, Chi Sage Publlcatlona. 

Smith, J. ft. I faith, ft. L. fltStl. Converaatlonal 
coat analyaia, Management Information. School 
Information and ftaaaarch Service , Olyapia, WA, £(5), 
21-27. 
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This is a 3-J#ered transparency. Poinfs 1>2 3 3 refer to layers of th^e transparency set. • 



Why do tie Ipok at costs and outcomes in evaluation? 



/••■' • 



In the past traditional Economists looked only at Costs.- However, in doing this the decision, maker 

east expensive option without knowuig if it works'! You can riot assume that an expense 



mqy select the leasi ^ 

program works while' an inexpensive one doesn't work/ 

In contrast* eduoatiorial researchers have focused on outcomes.* The 'problem here is that a program that is 
•orHy slightly more effective may be much more expensive. You wouldn't know without looking at costs also. 

The Decision Focused View looks at what it costs to product outcomes. This vUw has evolved^ue to reduced 
funding to education. The methods were developed in Sputnik era. (all three layers of transparency down for 
this- point) — - ^ ^_ v 

COSTS - 





OUTCOM ES 
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COST ANALYSIS. WORKSHOP OBJECTIVES* 



Tojircreuse understanding pU 



• Four cost analysis methods 
*> Method selection 

c. 

• Cost ingredients 

• Cost-outcome ratios 



Factors affecting cost analysis methods 
Techniques of ''streamlining" 



To practice identifying appropriate application 



1C9 
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• COST ANALYSIS WORKSHOP OBJECTIVES • 

Set parameters of the workshop • 
and limitfs of the appropriateness of 
the Methods here. Point out: 

*The analysis is limite A 
in terms of the infor- 
mation it can provid 
- but it can be useful 



in certain situations . 
We'll talk about those 
situations. . . contest 
of use . 

*We'll look at compari 
sons across 2 or more 
programs -hence it is 
a way to do a program 



To increase understanding of: 



evaluation usually 
within a school or 
district, (not natio 
wide or policy) 
Programmatic level 

A A.ialysis consists of 
discrete steps — each 
step alone can provide 
useful information. 
You don't need to do 
the whole thing to 
get goQd information 



• Four cost analysis methods 

« • * 

• Method selection- gvven a situation or problem^ which analysis is 

most appropriate? 

• Cost ingredients 

• Cost-outcome ratios 

• Factors affecting cost analysis methods - political and 

practical 

• Techniques of "streamlining" orwaya tomake the malyBi> 

more feasible or "do-able" in 
educatic&ial evaluation 

To practice identifying appropriate application using set of 

^^H^Ha^^^^^^^^B^^^^ H ^ M ^ M ^^^^^^^ H ^^^r , ats6s involving 

~ educational evaluation 



*llave them look at packet materials now* 



in 
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MANAGER (OR CONSUMER) 
ADMINISTRATOR 

/ 

PARTICIPANT 
COMMUNITY 



7 



Why did the decision focused view evolve; 



To answer 



QUESTIONS ASKED BY; 

MANAGER (OR CONSUMER)--—^ 

adopting the program 



ADMINISTRATOR- 



Where is the most money being spent? 



PARTICIPANT' "fo* 1 Bating for my money? 

COMMUNITY" do our tax moniea go? 



You can either uhow the next slide and identify the askers of the questions - 
Or have parUctpw.ta generate a list of queationa about ooata and/or outcomes 
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TO ANSWER QUESTIONS 

VA/ hat resources are needed to run the program?! 
What makes the program so expensive? 
Can we afford the program? 



Can we afford the program in 1987? - 

V 

Will we have funding in 1987? 

What are start up versus maintenance costs? 

Which program gives us the most outcome for the least money? 
How can costs be minimized? 



Co 



TO ANSWER QUESTIONS 



What resources are needed to run the program?- i^/m 
What makes the program so expensive? - Mnjoommity . 

Can we afford the program? - ('can we afford to start it? Can we afford to 

maintain it?) 



• Can we afford the program in 1987?- 



given inflation etc. 



sources 



Will we have funding in 1987 

are the funding 

What are start up versus maintenance costs? 

Which program gives us the most outcome for the least money? 
How can costs be minimized? 



Coat Analysis steps oan answer these questions. The resultant information can be used in decision making. 
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• COST ANALYSIS • 



COST FEASIBILITY 



COST UTILITY 



COST BENEFIT 



COST EFFECTIVENESS 



119 



Definition time. People will get terms mixed up. We use Cost Analysis (CA) 
to describe the 4 methods below. Levin used coat effectiveness (CE) to 
describe the 4 methods. The problem here is that people startxasking, about 
the CE o& a cost utility analysis!, Be careful to not mix the terms up as you 
describe them. \ 



• COST ANALYSIS • 



COST FEASIBILITY * - Descriptive of 

1 program or comparative to select between 2 or more programs 



COST UTILITY 



COST BENEFIT 



Comparative to select 
between 2 or more programs 



4- 



COST EFFECTIVENESS 



us 
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COST-ANALYSIS METHODS 

. t •■ 

INPUT OUTCOME METHOD 
Costs — — - 0 Feasibility 

, Costs Estimates Utility 

V 

• Costs Direct measures Effectiveness 
Costs Monetary measures Benefit 

121 
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Refer to hand-cut that defines the 4 methods. 

Cover columns 2 and 3 and point out that the oomnon denominator of all methods is assessing costs! 
The difference between the methods is the way they look at outcomes. Spy f9 We all do cost analyses 
every day > 99 and describe each method in practical terms. 
For example s consider buying a oar* . ' 



COST-ANALYSIS METHODS 



INPUT 

Costs 



OUTCOME 



METHOD 
Feasibility - can i afford it? 



Costs 



Estimates 



Utility - Do I need it? Is it useful? 



Costs 



Costs 



Direct measures 



Monetary measures 



* Of course , in buying a car these types of 
information won't determine exactly which 
car you'll buy I Other factors always 
affect a decision such as family needs s 
personal preferences for sportiness etc. 
<M is not a determinant - just another 
bit of information for decision making. 



Effectiveness - f ict \ mod 7 el ™ na . 

better for least money? 

Benefit - Which model has better 
resale value? Can theoretically compare 
different types of outcomes. There are 
some definition problem, that may be 
brought up by participai ts^ - say that % for 
now 3 CB is best for compai'vng outcomes of 
same- or similar types of programs- 
e.g. not $ value of health ed. versus 
$ value of typtng training. Rather t 
compare typing with computers (e.g. 
similar skills) 
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PRICING METHODS 

» 

r 

MARKET PRICING 
SHADOW PRICING 



ADJUSTMENTS FOR PRICING 

JOINT COST 
ANNUALIZED COST 
PRESENT COST 



I don't use this since it is too complex. You should* < however > be* aware of these concepts. 



PRICING METHODS ADJUSTMENTS FOR PRICING 



MARKET PRICING 



JOINT COST ~ ^ shaved ingredients e.g. Ms. Jones 

1/2 time 



SHADOW PRICING 



Usen annualization table in Levin's book. 



ANNUALIZED COST - if computer or building 

lasts more than 1 year - figures value based on 
depreciation and interest 

PRESENT COST - if program lasts more than 

one year 
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Mention CF first since there are no outcomes.. Next move to CU & OB "- both use 
Tt*Z measures very familiar to evaluates Could have partirtpmt generate 
this list, 

-thirst we'll look at conceptual models then go back and describe them step-by- 

\)TIUTY AND EFFECTIVENESS 



LEARNING BCE gains test scores 



SATISFACTION - parents, aotimunity, participants 



PHYSICAL S KILLS- *f iM f ahoea> et0 - 



PROGRAM COMPLETIONS 



REDUCTIONS IN DROPOUTS 



EMPLOYMENT OF GRADUATES 



COLLEGE PLACEMENT OF GRADUATES; 



120 
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UTILITY AND EFFECTIVENESS 

• LEARNING 

\ 

• SATISFACTION 

• PHYSICAL SKILLS 

• PROGRAM COMPLETIONS 

• REDUCTIONS IN DROPOUTS 

• EMPLOYMENT OF GRADUATES 

• COLLEGE PLACEMENT OF GRADUATES 
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BENEFIT 



DOLLAR VALUE OF LITERACY 



INCREASE IN INCOME 



DOLLAR VALUE OF IMPROVED QUALITY OF LIFE 



« DOLLAR VALUE OF INCREASING LIFE 
SPAN BY 2 YEARS 

• COST SAVINGS TO PARTICIPANTS 



1 ^9 
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Mention again, benefit allows comparison, of very different types of outcomes such aa math and reading. Note 
*that such comparisons rarely occur in eduo, evaluation. Rather, it is a comparison of reading CAT versus. 

reading Tutor. For this workshop we will attend primarily to lenefit of programs wihh same or similar outcomes. 

BENEFIT 



DOLLAR VALUE OF LITERACY 



INCREASE IN INCOME - e.g. vocational education 



DOLLAR VALUE OF IMPROVED QUALITY OF LIFE"~ 

reduction, "willingness to pay" 



DOLLAR VALUE OF INCREASING LIFE 

SPAN BY 2 YEARS tear* patient rehabilitation 



- if 8 top smoking 



COST SAVINGS TO PA RTIC I PA NTS - */ to d ° something 

they'd have to pay someone else to do^e.g. mechanics , 
self care. 



) So 



► METHOD SELECTION < 



DECISION PROBLEM? 

»i « . 

/ * 

IS THE RELATIONSHIP OF COST TO OUTCOME 
IMPORTANT TO THE DECISION MAKER? 



" Y 

COST FEASIBILITY 



NO 



COST UTILITY 



NO 



COST BENEFIT 



J 




YES 



ARE OUTCOME DATA 
ATTAINABLE? 



Jn^YES 



J 



[ARE 
,MOS' 
'DECI 



ARE EFFECTIVENESS MEASURES 
ST RELEVANT TO THE 
SION MAKERS? 



^►YES 



13i jCOST EFFECTIVENESSJ 
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To review the methods just described have participants work through this decision tree, 
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I make them answer each step while 
I keep the answers covered. On last 
step the "No" step to CB is awkward 
and another step would qsk 



►method selection < 



DECISION PROBLEM? 



I IS THE RELATIONSHIP OF COST TO OUTCOME 
\ IMPORTANT TO THE DECISION MAKER? J_ 



J 



COST FEASIBILITY 




NO 



COST UTILITY 



Is a dollar value of outcome relevant? 



Yes 



.__J 



NO 



^COST BENEFIT 
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YES 



ARE OUTCOME DATA 
ATTAINABLE? 



J^YES 



ARE EFFECTIVENESS MEASURES 
MOST RELEVANT TO THE 
DECISION MAKERS? , 



' i^YESw 
1C0ST EFFECTIVENESS, 



V 



INGREDIENTS 



ALL RESOURCES LISTED ( INCLUDING VOLUNTEERS ) 



FINE DETAIL NEEDED (E.G. PERSONNEL V.ERSUS TEACHER A, 
TEACHER B, ETC. ) 



CATEGORIZE BY ORDER OF COjT MAGNITUDE 
(E.G. PERSONNEL FIRST) 



ERIC 
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"Now to Coat a - 

First atep ia to Hat "Ingredient a" or "Paotore 1 ' needed to runtheprpgpam.i .Cjps.t .M-.irr.eZ^yaat, J^e^/?---.. 
all y&u ixint in a~ Hating of items" neoeaadry for the ' program'* * • 



INGREDIENTS 



•ALL RESOURCES LISTED ( INCLUDING VOLUNTEERS ) 

and 'free' reaouroea 

■s 

not but rather 

• FINE DETAIL NEEDED (E. G./\ PERSONNEL VERSU^\TEACHER A, 
TEACHER B, ETC.) * 



•CATEGORIZE BY ORDER OF COST MAG NITUDE 
(E.G. PERSONNEL FIRST) 
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INGREDIENTS 



Includes N f re-# r esou rces 

Includes "sunk" resources 

All materials even if shared 
by another program 
(e e g. computer) 

Costs figured for total 
program span 

Based on spent resources 



BUDGET 



Includes only financial resources 

May not include "sunk"resources 

Shared materials may be included 
in only one program's budget 

Costs figured for fiscal year only 
Based on allocated resources 



Inevitably people say - Well, why canH we just use our budget? 









INGREDIENTS 




BUDGET 


Includes "free" resources 




Includes only financial resources 


Includes "sunk 11 resources 




May not include u sunk n resources 


e.g. room rental if building already paid 






All materials even if shared 




Shared materials may be included 


bv another oroaram 

U j U 1 1 v I 1 1 w 1 yJ 1 w M 1 Mill 




in only one proaram's budqet 


\ Co y & LO III p U I c 1 ) 






Costs figured tor total 




Costs figured for fiscal year only 








capital outlay distortion (e.g. bus oost) 






Based on spent resources 




Based on allocated resources 
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Shows - maybe, what your school pays-but wouldn't tell 
others what they would need to implement the program! 
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THE INGREDIENTS APPROACH TO MEASURING COSTS 



CATEGORY COST TOTAL 



t 



f 1 AO 
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Have them list ingredients* You might provide a descriptions of a program 
and have them generate ingredients such as: 



THE INGREDIENTS APPROACH TO MEASURING COSTS 

Note: Note how useful it is to just list the ingredients to show what it 
takes to run the. program! 



CATEGORY 



Personnel 



Mr 8. Jones 1/2 tim e 
Mr* Smith full time 

Susie - tutor 
Rental 



rorv rental 



Equipment 



Apple He 



paper 



manuals 



Misc. evaluation 
staff training 



COST 



Cover 



TOTAL 




You aould use the Chapter 1 example here too. 
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• DISTRIBUTION OF COSTS * 

^^^^^^ 

COSTS TO: 

• SPONSOR 

• OTHER AGENCIES 

• VOLUNTEERS (CONTRIBUTED INPUTS) 

• PARTICIPANTS (IMPOSED INPUTS) 

144 



Besides identifying costs, the reliability of funding can be '.itermined. This lets you better 
answer the question - will we have funding in 1087? . 

★ DISTRIBUTION OF COS TS * 

You may find a distribution for program to be 2/3 district 
funded, 1/6 State and 1/6 federally funded. 

COSTS TO: " 



to 
Co 



SPONSOR 



OTHER AGENCIES 



VOLUNTEERS (CONTRIBUTED INPUTS)- donated equipment 

and personnel time 



PARTICIPANTS (IMPOSED INPUTS) 
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COMPUTER SKILLS TRAINING 
COURSES ' 

« 

Program # Students Language 

A 20 ' BASIC 

HANDS-ON 

B 20 Workbook 
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Now to an example* SIRS paper {.Cost Analysis for Educational 
Administrators)* p* 21 \ 



Program 



This example compares 2 

COMPUTER SKILLS TRAINING 



COURSES 



# Students 



Language 



Where 



20 



BASIC 

HANDS-ON 



CC 



B 



20 



Workbook 



HS 



Look at p, 22 where program coats are figured. Point 'out 
that only costs in addition to regular classroom costs are 
calculated. 

The listing of the coats is the cost feasibility analysis . 



*Smith & Smith (1984). 
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TABLE 2 
COST-UTILITY ANALYSIS 

PROGRAM A PROGRAM B 

PROBABILITY .6 .2 

UTILITY 6 6 

EXPECTED UTILITY (.6) (6)»3.6 (.2)6*1.2 

COST PER PUPIL $500 $300 

COST-UTILITY RATIO $500/3.6«$1 38.80 $300/1 .2-$250.00 
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P. 23* This example only looks at one outcome so utility, doesn't really net ! to be included. If you also 
had $ say, a "comfort" index for computer use you'd add the written-in figures. ^ ' 



TABLE 2 



COST-UTILITY ANALYSIS 



PROGRAM A 



PROGRAM B 



a. 

b. 
a. 

b. 

a. 
b. 



PROBABILITY (increasing test scores) 
Probability (increasing comfort) 
UTILITY (increasing test scores) 

Utility (increasing comfort) 

EXPECTED UTILITY (test) 

Expected Utility (comfort) 

COST PER PUPIL 



.6 

.6 

6 



(.6) (6)*3.6 

•(.6) (5) = 3.0 

$500 



.2 

.4 

6 



(.2)6-1.2 

(.4)'(5)= 2.0 

$300 



CO r J-UTILITY RATIO 



*500/3.6*$1 38.80 $300/1 .2-$250.00 



500/ 3.0 
+ 
3.6 

500/6.6 m 75. 75 



300/1 . 2 
f 

2.0 
300/3.2 



m 93.75 



9 
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*0f Smith and Smith, 1984. 



TABLE 3 
COST-BENEFIT ANALYSIS 

■I 

AVERAGE 

AX/FRAfiF COST RFNEFIT HOST/BENEFIT _NjUENEFIT 

PROGRAM A $500 $400 500/40Q--1 . 25 -$100 

PROGRAM B $300 $600 300/600* .50 *$300 



CO 

CD 



r 



TABLED 
COST-BENEFIT ANALYSIS 



P. 24 



Increase income per year 

AVERAGE/! v . „ 

avfrarf cost BFNEFIT*^ COST/BENEHT NET BEMEFIT . 

Restricted job market since leas It cost $1.25 to ratse 400-500 - 

PROGRAM A $500 ^««^-^$400 500 /400*1 ■ , ,25 ***f $uo ° 

Perhaps more jobs since more It oost 50$ to raise 6 qq 

PROGRAM B $300 ^^$600 300/600- '.6^3" »> ^ ■<"> *$3&d~ 



*Of Smith and Smith, 1984, 
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TABLE 4 

COST -EFFECTIVENESS ANALYSIS 

COST- 
COST PER PUPIL EFFECTIVENESS EFFECTIVENESS 

PROGRAM A $500 20 POINTS $500/20-$25 

PROGRAM B $300 5 POINTS $300/5 -$60 
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TABLE 4 

COST-EFFECTIVENESS ANALYSIS 



COST- 



COST PER PUPIL EFFECTIVENESS EFFECTIVENESS 



PROGRAM A 
PROGRAM B 



$500 
$300 



20 POINTS 



5 POINTS 



$500/20-$25 f- 
$300/5 -$60 f- 



If Ch 1 audience might mention error band around 
NCE*a or how to interpret if gain is in percentiles 
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COMPARISON 



Cost Select 

Feasibility B 
Utility A 
Benefit B 
Effectiveness A 



a' 
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COMPARISON OF EXAMPLE ANALYSES OUTCOMES 

* 

Cost Select 

Feasibility ft oosts B 

UTILITY effectiveness - handu on A — 

BENEFIT income - workbook B p 

Effectiveness effectivenecs • /tawis <?n 



/ 



Jftia points *o importance of identifying relevant 
program outcomes prior to conduct of the study, Jou 
would not ordinarily do all 4 analyses , This is for 
example only* 



BEST copy 
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PRAGMATIC 



4 EXISTENCE OF ALTERNATIVES 



• TIME 



COST 



AVAILABILITY OF COST DATA 



AVAILABILITY OF OUTCOME DATA 



• EXPERTISE OF THE STAFF 



AVAILABILITY OF EXPERT ADVICE 



Consider them oarefulty before undertaking a CA study. 



PRAGMATIC 



• EXISTENCE OF' ALTERNATIVES- 5 ' 2 <»• 

more programs ,*eed to be compared? if not - what 's the decision? 



• TIME-j* 

evaluation dependi 




more time than an outcome 
ailability of cost data 



COST 



N 



AVAILABILITY OF COST DATA 



just do outcome evaluation 



AVAILABILITY OF OUTCOME DATA 



Consider CF or CU 



EXPERTISE'OF THE STAFF 



AVAILABILITY OF EXPERT ADVICE 
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• IS THE DECISION MAKER INTERESTED? 

• WHAT OTHER FACTORS MIGHT 
INFLUENCE THE DECISION MAKER ? 

• WHAT ARE THE ADVANTAGES AND 
DISADVANTAGES? 
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^POLITICAL 



• IS THE DECISION MAKER INTERESTED? 

Will the information be used? If not s why bother? 



• WHAT OTHER FACTORS MIGHT 

INFLUENCE THE DECISION MAKER?-'/ ****** 

oan'.t agree on outcome measures - no analysis dill fit. 
Is funding available to support at least 1 program? 

* 

• WHAT ARE THE ADVANTAGES AND 
DISADVANTAGES? °^ havin9 thi8 in f° mati ° n? 

What if the moat politically preferred program ia leaat coat effective? etc. 



Exerciaes ahould be complete! by porticipanta now. 
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OUTCOMES 

IGNORE EFFECTS (feasibility) 

» 

ESTIMATE EFFECTS (utility) 

USE ALREADY COLLECTED DATA (last years) 

\ ' 

USE ANOTHER PROGRAM'S DATA 



OUTCOMES 

IGNORE EFFECTS (feasibility) 



ESTIMATE EFFECTS (utility) 



USE ALREADY COLLECTED DATA (last years) 



USE ANOTHER PROGRAM'S DATA 



STREAMLINING 



Conclude tilth discussion of uses in the audiences schools/districts 
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COSTING OUT 

LOOK AT COST OF PROGRAM 
FOR ONE YEAR ONLY 

DO NOT COST OUT "FREE" INGREDIENTS 



USE COST ESTIMATES FIGURED 
BY A SIMILAR PROGRAM 



These Leohniquea are reasonable - they do* however* compromise the results. Hence* their influence on 
analysis results should be recognized. . .These streamlined techniques should be used for local evaluations 
only (not to be published etc. since they estimate cost for the epeoific school/district only) 



COSTING OUT 



LOOK AT COST OF PROGRAM ' ' 

CAD AMr \/f-Ar» r\ " n amua ^ tze d & present 

rOK OIME YEAR ONLY va ^ ue adjustments are not necessary, 

DC NOT COST OUT 'FREE" INGREDIENTS 

Only cost out ingrec'.ients that go beyond regular program costs, (additional ingredients 
only) 

USE COST ESTIMATES FIGURED 

BY A SIMILAR PROGRAM - if ™ district etc. 



STREAMLINING 



at lev 



Note: Listing in^edients is single, so no streamlining is "eoormended for that step, 1 68 



HANDOUTS AND REFERENCES FOl 
PRESENTER'S GUIDE COST ANALYSIS WORKSHOP 



COST ANALYSIS MKTB0O6 



coat fcMibility 



estiastes the costs of t progrsa or progress with 
resources available to see it they ere affordable 

useful for prograa planning 
does not asssurs effectiveness 



coat utility 



oosperss ooata and 
program $ where 



for too or sort 
ara sstisatod 



♦ oany typoa of outeoano can ba included 

♦ iapsrfsot iaforoatien and uncertainty can ba 
addraaaad ayataaatieally 

roaulta aro not roplieablo 



coat banafit 



iraa tho ooata and outcoeas for too or nora 
progress, obaro ou t eoa n a aro ooaaurad in dollar a 



♦ oany typaa of outoocee can bo included 

♦ analysis is raplieablo 

it ia difficult to TAlua adueational outcoaoa 
sons tar ily 



coat effectivenaae 



♦ 



ooaparaa tho ooata and ou tco a oa for too or nora 
progress, where outeosos aro sessure* in taat 
scores f behavioral ratings, etc. 

effects data nsy bo available 
analysis raplieablo 

can only oospore progress with similar out e osos 



BEST COPY 
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RftMturch on Evaluation Progri 

SCO 8**41 SMhi 
•WtphOM (80S) J 
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From: Management Information, School 

Information" and Research Service , 
2(5) , Olympian WA, 1984 



Conversational cost analysis 
for educational administrators 



By Jana 



K.-£mlth 



and Nick L Smith 



fhmtm is no nnd to begin this peper with 
a description of the stress plaesd on educa- 
tionsl systemo by budget ..reductions. Mor is 
it necessary to point out inerssssd demands 
for socountability . Theoe srs now fssiliar 
issues fsesd dsily by educational administra- 
tors, mhat is not as familiar to most of us, 
however, are the seemingly esoteric cost 
analysis techniques that are being touted as 
the best methods for managing remaining avail- 
able funds and for providing accountability 
data. 



Cost analysis Is not really 
as unfriendly or forbidding 
as many educators Imagine 



Cost analysis sounds mechanical^ and un- 
feeling, and some people would probably prefer 
to keep such methods out of education. Educa- 
tional benefits cannot be translated into 
dollars! Other people are put off by the 
aposrent complexity of cost analysis tech- 
niques. Kowever, cost analysis is not really 
ss unfriendly or as forbidding as many educa- 
tors imagine. 

In the next few pages, we will introduce 
you to four common cost-analysis methods and 
provide exesplss to illustrate that these 
techniques, as applied to the equation of 
instructional programs, are such more 
straightforward and understandable than you 
might have thought, me are assuming that moat 
echool administrators will not conduct cost- 
anslysis studies themselves but instead may 
work with oonsultants or evaluators who do. 
Still, the administrator needs to be able to 
understand the methods sufficiently to make 
decisions based on the results as well as to 
explain his or bar decisions to others. After 
describing the four methods, we otter guide- 
lines, suggestions, and references for doing 
cost studies. * 

Cost- Analysis Methods 

The four formal cost-analysis methods seen 
as having the greatest usefulness in education 
are ooet^ feasibility, coat Jtility, coat- 
0 benefit, and eost-effectivoneaa analyses 

ERIC 



(Levin* 1981). The first method, coat-feasi- 
bility analysis, is useful for determining 
whether a program is affordable within budget- 
ary constraints. The last three methods 
enable you to combine outcomes with costs to 



First a method to determine 
budget feasibility; three 

methods combine outcomes, 
costs to determine most 
cost-efficient program 



determine the most cost-efficient program. 
Levin (1981, 1983) provides an excellent 
Introduction to .the use of these four methods. 

We will first discuss each cost-analysis 
method and then apply it to the same hypothet- 
ical educational problem to help you compare 
the differences in the methods. The problem 
concerns a computer skills training course for 
high school seniors, for which two alternative 
ten-week instructional programs srs being 
considered. Program A involves teaching 20 
students fivs hours weekly in tht programming 
language BASIC at a community college micro- 
computer laboratory across town. Seen student 
is to have a personal microcomputer for uss 
during classroom hours and access to the 
laboratory's programming consultant ss wsll ss 
to the special computer instructor hired for 
the program. Program • ia offered by the 
computer instructor to the 20 students st the 
high school and involves intensivs workbook 
exercises .in three different computer lan- 
guages. In addition to four hours of weekly 
instruction, these students will receive one- 
hour weekly "hands-on" experience scheduled on 
the 'high school's single microcomputer. We 
will return to this problsn to illustrate ssch 
of the four methods. 

Cost-ft ASlbillty Anslysis 

Cost-fsssibility analysis eat wastes the 
cost of s program or of alternative programs 
to see whether the program or which of the 
slternatives are possible within existing 
financial resources, you simply determine the 
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_. / ... ,. . 

oMt of venous coaponeate of •ash alternative 
*nd the* cooper e total costs with ttao amount 
of resourced available. Goat eetiaetea algae 
be the coats pro j scud bafoco ptocraas aca 
, actually iapleaonted, os tabulations of actual . 
costs Incurred by csletiao procraas. Ooat- 
feaaibllity dean aot deal at aU with prograa 
outcoaas, and tbscofeca provldee no Msy of 
eonbinine coata and outeoaoa in an overall 
analysis. . 

• / * 

Coeb- feasibility aatboda ata aoat appro- 
. prists tfban prograa outcoaas can bo eeeuand to 
ba equivalent or when dacisien askara consider 
progrso outcoaas to bo irrelevant. for 
eseaple, ona cost-fsssibility study conductad 
„ in Oregon datsralnad the coata of owning a bus 
transportation aystea versus contracting for 
bus transportation services. Jh9 school 
district aeauaed that both s Iter natives would 
provide equivalent tranaportation ear vices and 
ao outcoaas were not aeaaured (J. I. Smith, 
1913) . Ihe problem with aoat cost-fsssibility 



- studied, however, la that ausaarising eosta 
without eons ids ring outeoaoa results in know- 
ing which of seversl elternatlvee is cheapest, 
without knowing whether any of thaa produce 
the desired reeulte. 



Coshfeaslblllty methods 
are most appropriate whan 
program outcomes are 
equivalent or Irrelevant 



In the case of tlit computer training pro- 
grui f coat-feaalbllity ia aiqply determined 
« by aatimating the expected (or actually 
• incur tad) coata of aacb alternative, Tha 
total coat ia calculated by idantifying all 
tha componenta (ingradianta) naadad to run 
aach program* 'determining tha coat of aaeh 



Table I 

Coat Batimatea* of Two Computer SkiUa 
Training Programs 



Personnel 



Program A 



Computer Instructor $4000 
(MO/day s 5-day/wk m 10 wka) 



Program B 



Couputer Instructor 

(ISO/day x 5-day/wk x 10 wka) 



$4000 



Programing Consultant $1000 
($20 par hour s S hra x 10 wka) 



Pacilitiaa 



lent of microoomputer 

laboratory and aechinee $2400 

($48 per hour m 5 hr/Vk s 10 wka) 



Material* 



Computer Manuals. $ 
($10 per manual x 1 language x 
3 manuals x 20 atudenta) 



400 



Computer Manuals 

($10 per manual x 3 languagaa x 

3 manuala x 20 atudenta) 



$1800 



Workbook 

($3.33 per workbook x 3 work- 
books x 20 atudenta) 



$ 200 



Tranaportation Bua to Microoomputer 

Laboratory * $2000 

($20 per trip x 10 trlp/Vk 
x 10 wka) 

Total $10,000 $6,000 



•Only program coata in addition to normal school coata are included hares a full coat Hating would 
include a£l coata (e.g., even ooat of •rent* on program uee of classrooms etCo). 
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1 



LnSf, 



ingredient (valuing), and eumming the coata. 
Table 1 contains a sample ccet MMry for the 
two program. The to'al coata ere MtiMted 
to be $10,000 for Program A and $1,000 for 
prograa B. At 20 student, per L^f» ^f 0 ;' 
par atudant is $5.00 In Program a, and $30Q trr~ 
Frograa B. Mhich prograa alternative la 
fpaaibla dapanda upon ttaa budg.t allocation 
for tha eouraa. Moat liaely, tba adainiotre- 
tor would select Frograa I, ainca it ia tba 
'leas expensive option. 

In contrast to cost-analysis methode, 
traditional aducational eveluation atudiaa 
examine outcoaaa without ettention to coata 
and can raault in aalacting a prograa altarna- 
ti*e that ia only narginally acre effective, 
bub coneider ably more expensive than other 
alternatives. Haw instructional tachnologiaa 
of tan fall into thia lattar catagory. In our 
computer training coet-feeeibility esaaple, we 
can sat that axaaining only coata talla ua 
nothing about tha outcoaaa of either altarna- 
tlva. Only by incorporating both coata and 
outcoaaa within coaparetive atudiaa of prograa 
altarnatlvaa can ona raliably aetoraine which 
alternative ia aora affactiva for a given 
coat, or how auch it would coat to obtain a 
daalrad level of outcoaa, Tha following three 
tachniquaa allow ua to coabinf both coata and 
outcoaaa, in a aingla analyala. 



Qiat-Otllitv Analyaia 

Cost-utility analyaia goaa ona atap fur- 
thar than coet-feeeibility and aa^imatte the 
probability of tha expected outcoaaa of each 
•lt.rn.tiv.,. in thia aetbod, no ^"a 1 out- 
eoaa data are collected, but rathar "tiaatee 
of outcoaes' ara projactad. This analyaia ia 
halpful wheii outcoaa data ara unavailable., but 
ooae aaasaaaant of probabla outcoaa ia poe- 
aibla and deairable. Ona problem with coat- 



utility analyaia la that tha aaaauraa and 
analyaia ara not baaad on actual aaaauraa of 
outcoaa, oonaaguantly , tha raaulta will uaual- 
ly diffar, dapanding on who doaa tha analyaia. 
Thia for a of analyaia la uaaful .a a planning 
tool for adainiatratora whan funds for a 
foraal avaluation ara not available, whan tiaa 
conatralnta prohibit a lengthy data collection 
process, or as an aid in group discussions of 
possible pr'tgraa effecte. 



Cost-utility analysis Is 
« useful as a planning tool 
whan funds for a formal 
evaluation are not available 

Coat-utility analyaia can readily be 
applied to our computer training courae 
example. Firat, we already know that Frograa 
A coata $500 r-« pupil and Frograa B coata 
$300 par pupil", however, we have no indica- 
tion which prograa ia aora effective. Coat- 
utility analysis provides a aystematic way to 
eatiaate tha probable outcoaa of each alterna- 
tive. The ateps of a cost-utility °* 
the computer training alternativea ara liatad 
below and aumaariaed in Table 2. 

1. Batiaate tha probability of desired out- 
comes for Frograa A and Frograa B. Asaume 
in thia caaa that the expected outcoaa ia 
an increase of five pointa on a standard- 
ised teat of computer progressing axilla. 
For program A, a CO percent chance of auch 
an increaae ia anticipated becauae of tha 
extenelve time npent on the machinea, 
while for Frograa B, only a 20 percent 
chance of auch an increase ia expected 
(See Table 2)* Batiaatea of probable out- 



Table 2 

Coefc-Otility analyaia of Two Computer 
Training Prograaa 



if 



l 



ERIC 

nay- 



Probability of raising computer 
programing teat aoorea by 5 
pointa 

Utility of railing coaputer 
progr earning teat aoorea by 5 
pointa 

Bxpacted utility 
Coat par pupil 
Coat-utility ratio 



Prograa A 



.6 



(.4) (€)-3.6 
$500 



program B 



.2 



(.2)6-1.2 
$300 



BKST COPY 



$500/3. t»$13l. 00 $300/1. 2-$250. 00 
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coaes can be beetd on prior knowledge of 
aiailar prograaa, consensual HtHMnt 
ummq tnowledgsbls individuals, •» dworsgo 
eating of • nunber of staff, or even a 
alngle Individual's astlaata. 

2. Flaca an laportanee or utility value (uau- 
aUy baaed on a 10-point aeale, with 10 
representing the highss* vslue) on tha 
ostlaatad outeoaaa. In our exeaple, we 
judged that tha utility of ralalng tna 
eoaputar prograaaing taat aooraa waa tha 
aaaa for aaeb program and gave It a value 
of $. 

3. caloulata tha effected utUity of each 
prograa by alaply Multiplying tha expected 
outcome by lta utility. M lUuatratad in 
Yebls 2, tha expected utility for Program 
A la thraa tiaea that of Prograa I (3.6 
veraua 1.2). 

4. coaputa tha ooat-utility ratio by dividing 
tha co#*Tby tha axpaetad utility, in our 

I oxaaple, tha coat-utility ratio for Pro- 
graa A la IUt.10 (300/3^1) and tha coat- 
utility ratio for frograa 1 Is $230.00 
(300/1.2). 

Tha daelalon aaker would probably aalact 
Prograa A aa tha boat alternative. Given lta 
hlghar probability of achieving a flva-point 
gain, Alternative A la tha aoat coat afficlant 
and tha baat uaa of raaourcaa in aplta of lta 
hlghar coot. 

Coob-Bonof it Analyala 

Cost-bsnsflt analyala la baaad on objec- 
tive outccae aaaauraa which can ba expressed 
in taraa of dollara. Thorsfors, it prcvl dss 
raplicabla raaulta and enablea you to eeapare 
not only altarnatlvaa for a givan prograa, but 
•van alternative prograa a which have different 
outeoaaa. ■ecauae all outeoaaa are sxprssaed 
in eoaaon taraa (dollar bencflta) , one can 
eeapare reading prograaa with counaeling 
prograaa with athlatie prograaa. the aajor. 
problem with ualng coat-benefit analyala in 
evaluatlcna of instructions! prograaa la the 
difficulty and mssningfulness of aaalgning 
dollar valuaa to prograa outeoaaa. Parenta 



and edueatora alike are skeptical about dollar 
valuaa assigned to auch outeoaaa aa lncreaeed 
auaio appreciation, reading ooapreheneion, 
self-confidence, oc oath skills, and aay con- 
alder coat-benefit analyala aa Inappropriate, 
for prograaa with thoae outeoaaa. ] 

A cost-bensfit analyala can be applied to 
our eoaputar training eseaplt. Assums that 
both eoaputar/ training prograaa have been in 
effect for several yeers, each in a different 
high school, ■acauae of the reeent puah for 
vocational training, adalnlatratora are intsr- 
ssted in tha dlfferentUl earning powers of 
atudenta froa the two prograaa. He already 
* know that Prograa A coata $300 per pupil and / 
Prograa ■ coata $300 par pupil. He can eoa- / 
pare the yearly lnooae of a aaaple of resent / 
graduates of both prograaa to the Inecacof/ 
atudenta who did not participate in either/ 
prograa. Asauae that we find graduatsa freei 
Prograa A earned an average of $400 aore a 
year and graduatea froa frograr. 1 earned an 
average of $$00 aore a year than the ceaparl- 
aon group of graduatsa who participated in 
neither prograa. We aigbt auapeet that fro- 
graa B graduated ssrnsd aore than frograa A 
graduatea because they knew a wider range of 
programing languages than Prograa A atudenta. 
(In thia example, we are looking at only 
starting pay dlffereneea and so did net eatl- 
aate life-long lnooae. There are standard 
eeonealo aethoda for estiaating life-long 
income, but thoae aethoda go beyond the sccoe 
of thia paper and are not diacuaaed here.) 

The cost-benefit ration for thia exaaple 
can ba found by dividing the coat per atudent 
by the benefit for each atudent (see Table 
3) . in thia ea as, the coat exceeded the bene- 
fit In Prograa A ($500/$400)i it eeat $1.23 in 
prograa funda to lneraaae each atudent* s ln- 
eoaa by $1.00. The coat-benefit ratio ($300/ 
t40Q) froa frograa B, however, ahowa that the 
bensflts are twics that of the coats it cost 
only 30d in progrsa funds to lnerssss sach 
atudent* a lneeae by $1.00. Met bensfit, or 
ths saount of benefit accrued beyond the coat, 
can be calculated by subtracting coat froa the 
bensfit. for Program A, the net bsnsflt !• 
-$100 psr studsnt, whils for Progrsa a. It is 
$300 *per atudent. Baaed on the coat-benefit 



Table 3 

Cost-Benefit Anslysls of Two Coaputa r 
Training progrsa* 



Prograa A 
Prograa B 



Average) Cost 
Psr Studsnt 

'$300 

$300 



EMS School Information and Rotacrefi Service 



Average 
Benefit 
Per student 

$400 

$400 
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Coat/Benefit^ 
Patio 

300/400-1.23 

300/400* .50 

173 



Met Bsnsflt 
Per Student 

-$100 
••■$300 



best app v 



ratio and tha nat benafits, Prograa ■ ia 
claarly tha battar of tha two alta rnatlw as If 
ona ia intacaatad in increasing atudant inooae 
aftac graduation. Prograa i'a overall coat ia 
laaa and ita banafita are graatar. 



Program B Is clearly 
batter If one wants 
to Increase student 
Income after graduation 

Coat-Hfactivanaaa Analysis 

Coat-cffectivenoee analyais consists of 
raprasanting progcsa outeoaes, not in teraa of 
dollar unita, but in tana of othar effeotive- 
naas units, such aa raading ecoree, attituda 
ecorea, behavioral rating*, and ao on. Many 
of tbaaa effectiveneee aeesures ara tha etan- 
dard outeeae aeaeurea eurrantly uaad in aduca- 
tional a valuation, ■•causa you do not eonvart 
•11 outooaaa to tha aaaa unit (i.a. * dollar a) , 
you cannot uaa coeb-effectiveneea anal ysis to 
ooapara aoroaa prograas (a.g. » to ooapara 
raading prograas to athlete prograaa). 
Generally, however, this baa not baan a prob- 
lua in aducational evaluation, ainso 



aueh 



coapariaons have baan of lass intercat than 



such 
t 



coapariaona between progrsa alternativea, 
as which of two instructional atratagias 
effectively iaprove raading acoraa. 

Lat ua now apply cost-effectiveness snaly- 
sis to our coaputar training progrsaa. Tha 
prograw coats ara tha asm aa in tha preceding 
exaaplee. Suppoaa wa obtain a «*aaura of 
effectivencas by adainietering a atandarditad 
test of ganaral coaputar prograaning skills at 
tha baginning of aach coursa (pretest) and at 
tha and (poattast). Tha effectiveness of tha 
two prograas can than ba eoaparad by sawing 
how auch tha students gsinad (poattast - P ra- 
ta at) . Suppose student in Prograa ft gained 
an averag* of 20 pointa on tha taat, whila 
atudanta in Prograa B gainad only an avaraga 



of S pointa. Whan tha prcjran coat ia dividad 
by ita efffectivenees (i.e., its avaraga taat 
aeora gain) fee aach alternative, it ia clear 
that Prograa ft, although tha aoat expensive 
alternative, coats lass par point gain (aaa 
Tabla 4) . That ia, aach point gain in Prograa 
a. coats $25 ( 8500/20) , eoaparad to aach point 
,vAin on Prograa- • which coats $50 '$300/5). 
Tha decision aaker would likely pick prograa A 
aa tha beat altarnatiwa baaed on tbia analy- 
ais, which looks only at incraaaaa in test- 
aaasured prograaaing skills. Tha calculations 
for this analyais ara auaaariaad in Tabla 4. 

Discussion 

Tha rasults of tha praoading axaaplaa ara 
auaaarised in Tabla 5. As you csn saa, wa 
hava applied four eeSboda of coat-analysis to 



Applying four methods to 
same program results In 
different conclusions 



tha aaaa prograa and ooaa up with d if far ant 
conclusions. Tha coat-faasibility and coat- 
banafit analyaaa point to Prograa a aa tha 
boat alternative to aaleet (it ia cheaper; it 
contributes to increases in atudant inooaa) , N 
whila coat-utility and cost-effectiveness 
analyais point to Prograa ft aa tha boat slter- 
netiwo (it has. a highar probability of aue- 
casst it eontributoa to ineraasad atudant 
prograaaing akilla). Ona possible raaaon for 
thasa diacrapant raaulta in this asaapla la 
that Prograa ft, with its aura intanaiva hands- 
on training, raaulta in highar parforaanca on 
tha atandarditad taat. whan it caaa to tba 
atudanta receiving a highar paying job, how- 
•var. Prograa B caaa out ahaad bacausa atud- 
•nts wara axposad to a ore coaputar languagas, 
and could apply for a widar ranga of coaputar 
Jobs. 

Wa hava constructed thasa exeaples to 
daaonatrata tha laportance of eelecting tha 



Tabl* 4 

Coet-Effectiveneea Analysis of T*o 
Coaputar Training Prograas 



cost Par Pupil 



Bffectivenaes 
(Increase in 
taat acoraa) 



Coet- 
Sffactiveness 

ftatio 
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Prograa A $500 
prograa B $300 



20 pointa 
5 points 
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$500/20 » $25 
$300/5 • $40 , 
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1 




( sjerlaea of the 
Applied to the f 


Bsor Ooat-Analyele Matbeda 1 
no Computer Training frograi 


two 

■ \ 


Bathed 
Ceat- 

reaaibillty 


ZESSK9 

A 
B 


Coat tar 

ISOO 
1300 


Ooteouo 


Batlo 


B 


intarocaution 

Ceata acrt than available budgat 
Coat* laaa than available budget 


Coat- 
Otility 


A 
■ 


ISOO 
1300 


Upaetad Utility 
J.i* 
1.2* 


1900/3.1-113$. $0 
I300/1.2-I250.00 


A 


Baa a higbar probability of auooaaa 
Baa a lowar probability of wuomm 


Coat- 
Benefit 


A 
■ 


1300 


Dollar Benefit 
1100 


I900/400-I1.2S 
$300/100-$ .50 


B 


Baob 11.00 aarnad eoata 11.23 
Baob 11.00 aarnad eoata 10. SO 


Coet- 

UfKtlVMMU 


A 
■ 


ISOO 
1300 


laat STore Gain 
20 
S 


$300/30- |2S 
•300/5- $10 


A 


Bach point gain eoata $25 
Baob point gain eoata 110 



*Oae labia l_ jQr_jfce*rivativ« of tfceae figuree. 



proper coot-snslyala aethod. Zn moot oh, 
instruetienal method a or prograia are not 
intended to affect directly a student 'e income 



We have constructed these 
examples to demonstrate 
Importance of selecting 
proper cost-analysis method 



but rather ere intended to facilitate future 
learning and acbool performance. For example, 
a coat-benefit analyaia oJ third-grade reading 
inatruction eethoda would not only be diffi- 
cult, but usually irrelevant to the instruc- 
tion! question* of importance. Zn contrast, 
a coat-oxfectiveneaa analyaia of tho reeding 
instruction aothods would be highly epproprl- 

eld) e ° * 

Ms believu that, for the majority of 
educational evaluations, coet-ef feet ivenea a 
analyaia ia the beat coat-analyais ■ethod to 
oat whon a full evaluation ia poaeible. only 
for vocationally-oriented programs where the 
goel ia to improve student marketability or 
job performance would cost benefit analyaia be 
the preferred method, for our computer train- 
ing program esampU, either cost-off eoUvoness 
or coat-benefit analyaia la appropriate. Zn 
aelecting which method to use, the adminiatra- 
. tor vould have to assess carefully whether 
toit performance or income wss more important, 
and then use the method which incorporate a 
that outcome. Generally, this deciaion ia 
made prior to the coat analysis sod only s 
alngl* analyaia is conducted, but «as wo have 
illuatrated, one could conduct both analyses 
in order to make a more informed decision. 



f 



should 
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aav ',>■*, eost-fosaibility analy. a 
» used » »e determining whether s 
program is economic xy f eaaiblo under budget- 
ary constraints., no outcome' data are taken 
into account uaing this method, sir* conse- 
quently there ia no evidence to suggeat which 
program is more effective. Co a&- utility snsl- 
ysle goes one step beyond cost-,"«raslblllty and 
adds estimates of program outcomea. Because 
the outcome data are estimated rather than 
actually measured, however, the procedure ia 
not tollable but say be helpful la planning 
aituatic*^. Cost-benefit analya< • places a 
dollar gure on program outcome ehlch is then 
cce?. , — to the cost of the program, xt is 
oft r o ff Jcult to vsluo educational outcomes 
in «c "^r terms and, aa s result, the useful" 
nesa of thla method la generally limited to 
vocationally-oriented inatrjc clonal programs. 
Finally, coet-ef fectivaneaa analyaia involve a 
collecting data on program effects uaing 
traditional evaluation meaaurss. Theae aea- 
eures are then compared to the coat of the 
alternatlres-. Cost-effectlvonoaa analyse y are 
appropriate for evaluating programs with Iden- 
tical or aiallar outcome mescures. of the 
four tecbnlquee, wo recommend coet-ef fectlve- 
nesa analyaia aa the beat method far use in 
the evaluation of alternative lnatructlonal 
programs. 

A few alda are available for thoae adei.t- 
latratora Jterea^ed In learning awe about 
coet-enalyax. procedurea. No have developed a 
comprehenalve check lie t tor planning, cealgn- 
lng, ccoJucting, and reporting a coat- effec- 
tiveness study. The checklist can also be 
ueed in reviewing peat cost-off ectiveneee 
atudies ss wsU. The entire checklist is too 
long to reproduce here, but s free copy nay bs 
obtained by writing the ascend author of this 
paper. Me have also listed s few Kipf.il 
roadlngs in the reference a which folio* to 
help you pursue these msthoda further. 
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M you can — from our eraaplea, the 
differences between tlM lour major types of 
coat-enelyele methods or* clear and iuy to 
understand. Nhile conducting a coat analyaia 
study can t •quirt considerable time , effort , 
and erpertiac, you already have a sufficient 
undsratandiiig of ths basic approaches to begin 
considering the us* of formal coat otudiee in 
your own setting. Mho knows, with help fro! 
some evaluation and businees office etaff, 
there stay be a coat * atudy or two in your 
future. Good luck! 
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(Editor's note: Jana Kay Smith, Eveluatio 
Specielist, and Mick L. Smith, Director, ar 
with the Beaearch on Evaluation Program of th 
Northwest Regional Educational Laboratory. Thi 
paper results from a aeries of research activ 
ities deaigned to adept cost-analysis technique 
for eveluative usea. The work reported herei 
wee aupported in pert by the National Institut 
of Education through Contract Mo. 400-80-0105 t 
the Morthweat Regional Educational laboratory 
It d©<« not nec-iserily reflect the vi ews o 
either agency, nowever, end no endorsement 
ahould be inferred.) 
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iHAPTER 1 EXAMPLE li.237.lH 
PROJECTED COSTS 



Salaries and Benefits 

Director /Teacher I .8FTE* 13,747.10 
Aids • .BITE* 8,280.00 



Consultants 
Evaluator 

Title I outcome avaluation 3.700.00 

Process avaluation of program 1,800.00 
Reading Specialist 

7 days consulting f $100/day 700.00 
Traval axpansas (milaaga 8 

15«/aile) 69.90 



Traval 

Titla I taachar attands National 

Raading Association Confarance in 

San Francisco, Fab. 4-7 

Par diaa 160.00 
Traval 420.00 



PAC Activitiaa 

Needs Assassnant 430.00 

Attandanca at stata Titla I conference 75.00 

Arranganants for 2 opan aaatings 55.00 

PAC consultants (2 for 1 day 8 $60/day) 120.00 



TfTALS 



22,027.00 



5,269.90 



580.00 



700.00 



Materials 
Books 

4 copias aach of assortad raading 
books for 2-5 grada raadars 

(list available upon raquest) 100. CO 

5 sats— Spacial Reader's sarias 300.00 

*Tha other .2FTS for tha taachar and aide are spent with tha Title I Math 
project. 
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Projected Budget-page 2 

Tapes/Pilms/Pilmstrips 

Pilastrips with tht Special 

Reader's itriti 380 • 00 

Pilms o£ episodes in four books 

purchased lilt year 
Videotapes for plays put on by 

students xtu.uu 



Supplies and Copying 

Scissors (15 pairs) ^-JJ 

, 30.00 

Photocopying J 

Construction paper mm 

Ditto masttrs *"* WM 



150.00 



Comprehensive Achievement Batttry- 

100 tests fall and spring, plus 

publisher's scoring 
Reeding Diagnostic Test 

:5 ° -• ,t " , 25 00 

150 student report forms «* uu 

informal test booklets for the 

Special Reader's aeries «- ou 



Equipment 725.00 

Reading resource console '« 

Videotape machine A ' uo " 

Replacement of 2 reading 1 100 0Q 

machines 9 $550 each ^ 10 ° ■ 



TOTAL PROJECT 



BEST COPY 



1,512.50 



2 f 910. 50 

33,000.00 33,000.00 
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COST ESTIMATION WORKSHEET 



BUDGET CATEGORY 


COST 


. TOTAL 


Salaries + Benefits 
Director/Teacher 
Aide 

» 










Consultants 











Travel 



PAC Activities 



NWREL TAC 
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jmQSn CATEGORY 

Materials 



Audio-visual 



Supplies + Copying 



Tests—., 



NWREL TAC 



COST 


TOTAL 




1 
































J 
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BUDGET CATEGORY 



COST 



TOTAL 



Equipment 



V 



Building 



Other 



181 
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■ t 
4 

Estimated total project cost 

ti 


$33,000.00 


Estimated number served 


77/ 

77 Y\i 


Estimated average cost per 
student served 

a * 


$428.57 


Estimated improvement in 
achievement caused by Title I 


12 points 


Cost effectiveness ratio ■ 




(avg. cost per student) 

(avg. achievement improvement) 


$35.71* 


■dollars spent n*r unit 




improved achievement 
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therefore, Alternative A is more cost effective here. 
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COST EFFECTIVENESS RATIO 
EXAMPLE 2 



13.022 T 





Alternative 




A 


B 


ll 

Estimated total project cost 


$33,000.00 

i 


$33, MO. 00 


Estimated number served 


77 


100 


Estimated average cost per 
student served,. . 


$428.57 

* 


$330. 00 


Estimated improvement in student 

nr h i au em pnt rfliKflrf hv Title I 


15 points 


15 points s 


Cost effectiveness ratio - 






(avg. cost per student) 

(avg. improvement in attitude) 


$28.57 


$22.00* 


■ dollars spent per unit 


1 


1 


improved achievement 

i 


t 

"i 





•Therefore, alternative B is mure cost effective here. 
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EXERCISES 



instruction.: Described on the following MM m ils •^f" 0 ? 8 ; por 
each situation, answer .11 of the questions lilt* below. Select * 
spokesperson who wfri report your conclusions to the rest of the group. 

1. What program alternatives are being considered? 

2. What cost analysis method seems most appropriate (cost feasibility; 
' cost utility; cost benefit; cost effectiveness)? 

3. What pragmatic factors might affect the conduct of the analysis? 

4. What political factors might affect the conduct of the analysis 
and/or the use of the results in decision making? 

5. Given the pragmatic and political factors you listed in J*-"** 0 " 8 3 
and 4. do you still think the cost analysis method you chose in 
question 2 is most appropriate? If not, what else would you suggest? 

6. Briefly outline the steps of your analysis and include a description 
of your outcome measures (if appropriate). 
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1; Over the past several years, NCE gains for the elementary school 
Chapter 1 mathematics program in a large urban district have been 
disappointingly low. In response to these results, the Chapter 1 
program staff identified two new programs for consideration. They 
decided to pilot test both programs to help them decide which should 
be adopted by the district. Two schools with comparable student 
populations and a Chapter 1 program in grades 2-4 were selected to 
pilot test the two programs. Program A resulted in a project gain of 
6 WCES, while Program B yielded a gain of 2 NCES. The costs of the 
two programs were $300 per pupil for Program A and $75 per pupil^for 
Program B. 



2. The school board is concerned about the costs of bus service which 
have continued to rise despite declining student enrollment. They 
are considering the following 3 alternatives: (1) continue to 
provide bus services (2) contract with an independent bus service* * 
and (3) eliminate bus service. 

,/-" 



3. In order to qualify for federal funding under P.I. 94-142, local 
school districts must invest a substantial portion of their locally 
generated revenues to provide educational services to handicapped 
children. In turn, this education is believed to help these students 
find jobs and thus reduce the cost of unemployment and social 
services, and help make handicapped people more self-suff iciei 
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A A state department of education had a five year contract with the 
federal government to provide teacher training «»i«t«ce to echool 
districts in ita state.- the contract had a provision that allowed 
t£ go£rn£nt to cancel the contract. A number of similar contracts 
with other stite departments of education had recently been cancelled, 
Project administrators were debating whether or not to start a new 
training program that would take three years to complete. 



-V" 



5« A state funded compensatory education program provides funding in the 
amount of $200 per qualifying pupil in grade. 1-6., Bacent test 
results indicate that the pupil .hoy. substantial success in the 
orimary grades (1-3) while only limited success in grades 4-6. The 
Ha^^eg"lature is planning to provide additional funds for this 
program, but first wants the Department of Education to provide , 
information as to how those funds-ee^uld best be spent^__._. i / 



6 A state is considering the building of ten regional vocational 
Jecnnical training centers at... cost of/abcut $5.5 million each 
TfoVe going through with these plans /state, decision makers haVe 
Tslll the S2part«ent of Education, to provide them with information 
Indicating tnat the costs of the program will be justified through 
^ures such as increased earning potential and better employment 
prospects for vocational/technical graduates. 
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